[ 472.208318] env[64436]: INFO neutron.common.config [-] Logging enabled! [ 472.208318] env[64436]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev50 [ 472.208318] env[64436]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=64436) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 472.208318] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 472.208318] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 472.208318] env[64436]: WARNING oslo_policy.policy [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 472.208318] env[64436]: WARNING oslo_policy.policy [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 472.208318] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] VMware NSXv3 Agent initialized successfully. [ 472.208944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] Acquiring lock "singleton_lock" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 472.208944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] Acquired lock "singleton_lock" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 472.208944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] Releasing lock "singleton_lock" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 472.209311] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] Full set of CONF: {{(pid=64436) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} [ 472.209395] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ******************************************************************************** {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 472.209482] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] Configuration options gathered from: {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 472.209849] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 472.210195] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 472.210195] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ================================================================================ {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 472.210336] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] agent_down_time = 75 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.210470] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] allow_automatic_dhcp_failover = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.210888] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] allow_bulk = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.210888] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] api_extensions_path = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.211035] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] api_paste_config = api-paste.ini {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.211093] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] auth_strategy = keystone {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.211177] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] backdoor_port = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.211288] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] backdoor_socket = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214013] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] backlog = 4096 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214013] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] base_mac = fa:16:3e:00:00:00 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214013] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] bind_host = 0.0.0.0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214013] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] bind_port = 9696 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214013] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] client_socket_timeout = 900 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214013] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] config_dir = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214013] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214256] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] config_source = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214256] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] control_exchange = neutron {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214256] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] core_plugin = ml2 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214256] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] debug = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214256] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] default_availability_zones = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214463] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214463] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] dhcp_agent_notification = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214463] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] dhcp_agents_per_network = 1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214463] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] dhcp_lease_duration = 86400 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214463] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] dhcp_load_type = networks {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] dns_domain = openstacklocal {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] enable_default_route_bfd = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] enable_default_route_ecmp = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] enable_dvr = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] enable_new_agents = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214893] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] enable_services_on_agents_with_admin_state_down = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.214893] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] enable_signals = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.215133] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] enable_traditional_dhcp = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.215198] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] external_dns_driver = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.215322] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] filter_validation = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.215468] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] global_physnet_mtu = 8950 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.215666] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] graceful_shutdown_timeout = 60 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.215794] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] host = cpu-1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.219813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] host_dvr_for_dhcp = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.219813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] http_retries = 3 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.219813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] instance_format = [instance: %(uuid)s] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.219813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.219813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ipam_driver = internal {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.219813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ipv6_pd_enabled = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.219813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] l3_ha = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220222] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220222] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] l3_ha_network_physical_name = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220222] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] l3_ha_network_type = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220222] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_color = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220222] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_config_append = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220222] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220222] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_dir = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220411] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_file = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220411] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_options = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220411] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_rotate_interval = 1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220411] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_rotate_interval_type = days {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220411] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] log_rotation_type = none {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220411] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220567] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220567] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220567] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220567] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220567] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] max_dns_nameservers = 5 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220567] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] max_header_line = 16384 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220724] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] max_l3_agents_per_router = 3 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220724] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] max_logfile_count = 30 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220724] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] max_logfile_size_mb = 200 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220724] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] max_subnet_host_routes = 20 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220724] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] my_ip = 10.180.1.21 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220724] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] my_ipv6 = ::1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220724] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] network_auto_schedule = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220898] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] network_link_prefix = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220898] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220898] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] notify_nova_on_port_data_changes = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.220898] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] notify_nova_on_port_status_changes = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221223] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] pagination_max_limit = -1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221223] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] publish_errors = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221369] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] rate_limit_burst = 0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221429] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] rate_limit_except_level = CRITICAL {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221590] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] rate_limit_interval = 0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221717] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] retry_until_window = 30 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221854] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] router_distributed = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.221990] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] rpc_resources_processing_step = 20 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.222371] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] rpc_response_max_timeout = 600 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.222371] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] rpc_response_timeout = 60 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.222589] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] send_events_interval = 2 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.222589] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] service_plugins = ['router'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.222713] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] setproctitle = on {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.223030] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] shell_completion = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.223030] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] state_path = /opt/stack/data/neutron {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.223192] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] syslog_log_facility = LOG_USER {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.223310] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] tcp_keepidle = 600 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.232617] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] transport_url = **** {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.232617] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] use_journal = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.232617] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] use_json = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.232617] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] use_ssl = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.232617] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] use_stderr = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.232617] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] use_syslog = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.232617] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] vlan_qinq = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.233137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] vlan_transparent = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.233137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] watch_log_file = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.233137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] wsgi_default_pool_size = 100 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.233137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] wsgi_keep_alive = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.233137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.233137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] wsgi_server_debug = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 472.233137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_concurrency.disable_process_locking = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233405] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233405] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233405] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233405] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233405] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233405] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233405] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.connection_string = messaging:// {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233609] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.enabled = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233609] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.es_doc_type = notification {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233609] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.es_scroll_size = 10000 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233609] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.es_scroll_time = 2m {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233609] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.filter_error_trace = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233609] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.hmac_keys = **** {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233609] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.sentinel_service_name = mymaster {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233793] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.socket_timeout = 0.1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233793] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.trace_requests = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233793] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler.trace_sqlalchemy = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233793] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler_jaeger.process_tags = {} {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233793] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler_jaeger.service_name_prefix = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233793] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] profiler_otlp.service_name_prefix = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233793] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.enforce_new_defaults = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233969] env[64436]: WARNING oslo_config.cfg [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 472.233969] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.enforce_scope = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233969] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.policy_default_rule = default {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233969] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233969] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.233969] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234190] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234190] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234190] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234190] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234190] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_policy.remote_timeout = 60.0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234190] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234190] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] agent.extensions = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234380] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234380] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] service_providers.service_provider = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234380] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.default_quota = -1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234380] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234380] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_floatingip = 50 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234380] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_network = 100 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234380] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_port = 500 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234678] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_rbac_policy = 10 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234678] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_router = 10 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234678] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_security_group = 10 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234678] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_security_group_rule = 100 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234678] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.quota_subnet = 100 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234678] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] QUOTAS.track_quota_usage = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234678] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234925] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep.group = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234925] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep.helper_command = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234925] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep.logger_name = oslo_privsep.daemon {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234925] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep.thread_pool_size = 8 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234925] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep.user = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234925] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.234925] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_dhcp_release.group = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_dhcp_release.helper_command = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_dhcp_release.user = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_ovs_vsctl.group = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_ovs_vsctl.helper_command = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235346] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235346] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235346] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_ovs_vsctl.user = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235346] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_namespace.capabilities = [21] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235346] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_namespace.group = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235346] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_namespace.helper_command = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235531] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235607] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_namespace.thread_pool_size = 8 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235744] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_namespace.user = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.235896] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_conntrack.capabilities = [12] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.236047] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_conntrack.group = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.236189] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_conntrack.helper_command = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.236337] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.236484] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_conntrack.thread_pool_size = 8 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.236638] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_conntrack.user = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.236797] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_link.capabilities = [12, 21] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.236942] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_link.group = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.237098] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_link.helper_command = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.237243] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.237384] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_link.thread_pool_size = 8 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.237528] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] privsep_link.user = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.237693] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.237847] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.237996] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.continue_on_failed_promotions = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.238154] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.dscp = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.238300] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.dscp_inherit = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.238456] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.force_mp_to_policy = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.238604] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.locking_coordinator_url = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.238750] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.log_agent_heartbeats = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.238898] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.logging_expire = 1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.239095] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.239219] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.239376] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.polling_interval = 240 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.239528] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.239707] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.quitting_rpc_timeout = 120 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.239843] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.report_interval = 30.0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.239996] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.240186] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.240321] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.240472] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.sync_skew = 60 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.240619] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.synchronization_queue_size = 20 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.240812] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT.use_helper_for_ns_read = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.240929] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] SECURITYGROUP.enable_ipset = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.241094] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] SECURITYGROUP.enable_security_group = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.241251] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.241542] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.241629] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] experimental.ipv6_pd_enabled = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.241739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.extension_drivers = ['port_security'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.241882] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.external_network_type = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.242052] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.242221] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.overlay_ip_version = 4 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.242369] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.path_mtu = 8950 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.242542] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.physical_network_mtus = {} {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.242796] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.tenant_network_types = ['vlan'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.242959] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.243131] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ml2.type_drivers = ['vlan'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.243288] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT_CLI.neutron_port_id = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.243436] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.243581] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.243738] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.243892] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.244056] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.244215] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.244371] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.244558] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.244765] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.244931] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_login_password = **** {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.245103] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_login_port = 443 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.245261] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_login_user = admin {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.245413] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.245569] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.245723] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.245869] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.246036] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.246196] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.246349] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.246501] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.246652] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.246813] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.246983] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.247149] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.247306] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.247509] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.247671] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] vsphere.vsphere_login_password = VMware1! {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.247823] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.247971] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.248137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.auth_section = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.248295] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.auth_type = password {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.248450] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.248594] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.certfile = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.248744] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.collect_timing = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.248899] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.endpoint_type = public {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.249056] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.insecure = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.249202] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.keyfile = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.249352] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.region_name = RegionOne {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.249497] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.split_loggers = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.249638] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] nova.timeout = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.249785] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.auth_section = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.249937] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.auth_type = password {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.250105] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.250250] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.certfile = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.250396] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.collect_timing = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.250546] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.endpoint_type = public {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.250690] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.insecure = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.250844] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.keyfile = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.250980] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.region_name = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.251135] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.split_loggers = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.251275] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] placement.timeout = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.251423] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.auth_section = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.251565] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.auth_type = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.251705] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.cafile = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.251845] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.certfile = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.251985] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.collect_timing = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.252137] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.connect_retries = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.252278] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.connect_retry_delay = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.252438] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.enable_notifications = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.252595] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.endpoint_override = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.252743] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.insecure = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.252886] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.interface = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.253037] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.keyfile = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.253181] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.max_version = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.253321] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.min_version = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.253460] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.region_name = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.253598] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.retriable_status_codes = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.253739] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.service_name = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.253878] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.service_type = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.254032] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.split_loggers = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.254176] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.status_code_retries = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.254316] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.status_code_retry_delay = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.254467] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.timeout = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.254635] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.valid_interfaces = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.254786] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ironic.version = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.254941] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] cli_script.dry_run = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.255106] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.255250] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.255399] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.255563] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.255722] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.255867] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.256017] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.256165] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.256309] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.256463] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.256607] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.256761] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.256913] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.257072] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.257227] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.257373] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.257519] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.257671] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.257823] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.257984] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.258151] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.258299] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.258445] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.258587] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.258733] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.258874] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.259027] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.259173] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.259318] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.259462] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.ssl = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.259619] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.259774] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.259918] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.260075] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.260227] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.ssl_version = {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.260370] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.260525] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_notifications.driver = [] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.260671] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_notifications.retry = -1 {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.260830] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.260972] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] oslo_messaging_notifications.transport_url = **** {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 472.261094] env[64436]: DEBUG oslo_service.service [None req-db176ffa-b824-4bce-b9ea-75215074dccf None None] ******************************************************************************** {{(pid=64436) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 472.262144] env[64436]: DEBUG neutron.agent.securitygroups_rpc [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Init firewall settings (driver=nsxv3) {{(pid=64436) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 472.263522] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=64436) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 472.263765] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] RPC agent_id: nsxm-l-01a.corp.local [ 472.266116] env[64436]: DEBUG dogpile.cache.region [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 472.266243] env[64436]: DEBUG dogpile.lock [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 472.266347] env[64436]: DEBUG dogpile.lock [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 472.266451] env[64436]: DEBUG dogpile.lock [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 472.266552] env[64436]: DEBUG dogpile.cache.region [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 472.266646] env[64436]: DEBUG dogpile.lock [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 472.266777] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 472.288355] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Session token - acquiring [ 472.290183] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 472.290382] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 472.290480] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 472.290950] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 472.308216] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 472.584396] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 472.607936] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 472.608155] env[64436]: DEBUG dogpile.cache.region [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Cache value generated in 0.341 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 472.608233] env[64436]: DEBUG dogpile.lock [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 472.608346] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Activating Policy API Provider. [ 472.608540] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Looking for the default Infrastructure Rules. [ 472.671911] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Looking for the Default Layer3 Logged Drop Section. [ 472.686274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 472.686729] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 472.686911] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 472.687034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 472.687331] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 472.687662] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 473.202476] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 473.705018] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 474.209031] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Inventory metadata is going to be refreshed. [ 474.209031] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 475.082021] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 475.082021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 475.082021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 475.082021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 475.093764] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 475.095142] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.097823] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 475.115017] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 475.115017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 475.115017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 475.115017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 475.115017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.115017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 475.115017] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 475.115017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 475.133173] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 475.133676] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 475.135897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 475.135897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 475.135897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.135897] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 475.154893] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 475.156227] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 475.156227] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 475.156227] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 475.156227] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.156546] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 475.179087] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 475.181603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 475.181603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 475.181603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 475.181603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.181603] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 475.181603] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 475.181603] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 475.200850] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 475.200850] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 475.200850] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 475.200850] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 475.200850] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.200850] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 475.200850] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 475.200850] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 475.222017] env[64436]: DEBUG networking_nsxv3.common.locking [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 475.222017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 475.222017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 475.222017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 475.222017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.222017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 475.222017] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 475.222017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Inventory metadata have been refreshed. [ 475.222017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Dryrun:True. Metadata refresh completed. [ 475.222017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Releasing lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 475.223144] env[64436]: INFO neutron.agent.agent_extensions_manager [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Loaded agent extensions: [] [ 475.224000] env[64436]: DEBUG neutron_lib.callbacks.manager [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=64436) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 475.278055] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent RPC Daemon Started! [ 475.278055] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent loop - iteration:0 started [ 475.278055] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent out of sync with plugin! [ 480.225091] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 480.225091] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 485.226017] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 485.226353] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 488.227946] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 488.228359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 488.228359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 488.228793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 488.229094] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 488.732634] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 489.198123] env[64436]: INFO networking_nsxv3.common.synchronization [None req-3e663673-ab2d-4ac9-9cbd-9c1d44276c01 demo admin] Enqueued Resource ID: c8d74c22-f324-4856-8818-a8f73723eaa9 with Priority: HIGHEST for action security_group_rules [ 489.198417] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d74c22-f324-4856-8818-a8f73723eaa9 with Priority: HIGHEST for action security_group_rules [ 489.198717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8d74c22-f324-4856-8818-a8f73723eaa9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 489.198843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8d74c22-f324-4856-8818-a8f73723eaa9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 489.198913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8d74c22-f324-4856-8818-a8f73723eaa9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 489.199322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8d74c22-f324-4856-8818-a8f73723eaa9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 489.199440] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8d74c22-f324-4856-8818-a8f73723eaa9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 489.234641] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 489.719022] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 489.719022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 489.719022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 489.719324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 489.719324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 489.719324] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8d74c22-f324-4856-8818-a8f73723eaa9 already deleted. [ 489.719324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8d74c22-f324-4856-8818-a8f73723eaa9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 489.736771] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 489.736931] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 490.506767] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.507193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.507193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.507313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.519353] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 490.520252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.520832] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 490.543981] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.544116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.544193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.544374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.544456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.544559] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 490.544632] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 490.544748] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 490.566329] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.566450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.566497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.566663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.566784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.566882] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 490.587220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.587407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.587407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.587554] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.587645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.587742] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 490.611971] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.612101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.612162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.612326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.612417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.612518] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 490.612592] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 490.612661] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 490.628199] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.628362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.628474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.628717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.628835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.628968] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 490.629082] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 490.629164] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 490.649423] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.649543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.649613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.649778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.649877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.649982] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 490.650066] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 490.650134] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 490.650200] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 490.650274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 490.650337] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 490.650399] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 490.650654] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 490.650718] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 490.650786] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 490.671013] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.671188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.671233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.671367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.671462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.671561] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 490.690114] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 490.690240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 490.690282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 490.690441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 490.690533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 490.701829] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 494.199550] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 494.199915] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 499.200954] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 499.201210] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 504.202837] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 504.203307] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 509.204330] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 509.204685] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 514.206045] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 514.206311] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 518.283874] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b71ec9e2-152c-440a-ad7e-afa23d8e03e7 None None] Enqueued Resource ID: 8b09ffe5-06c0-410b-acbf-7dd1c8e316b9 with Priority: HIGHEST for action port [ 518.284443] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b09ffe5-06c0-410b-acbf-7dd1c8e316b9 with Priority: HIGHEST for action port [ 518.284777] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b09ffe5-06c0-410b-acbf-7dd1c8e316b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 518.284916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b09ffe5-06c0-410b-acbf-7dd1c8e316b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 518.285011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b09ffe5-06c0-410b-acbf-7dd1c8e316b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 518.290992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b09ffe5-06c0-410b-acbf-7dd1c8e316b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 518.290992] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b09ffe5-06c0-410b-acbf-7dd1c8e316b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 518.676237] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d8545bc3-22e9-4bf2-87e5-ca3e48ff1be0 None None] Enqueued Resource ID: 3d9a2b82-a0af-4991-aa09-08fe272f349c with Priority: HIGHEST for action port [ 518.679179] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d9a2b82-a0af-4991-aa09-08fe272f349c with Priority: HIGHEST for action port [ 518.679179] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d9a2b82-a0af-4991-aa09-08fe272f349c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 518.679179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d9a2b82-a0af-4991-aa09-08fe272f349c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 518.679179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d9a2b82-a0af-4991-aa09-08fe272f349c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 518.679179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d9a2b82-a0af-4991-aa09-08fe272f349c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 518.679179] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d9a2b82-a0af-4991-aa09-08fe272f349c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 518.797132] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b09ffe5-06c0-410b-acbf-7dd1c8e316b9 [ 518.797132] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 518.797132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 518.797132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 518.797132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 518.797132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 518.797132] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b09ffe5-06c0-410b-acbf-7dd1c8e316b9 already deleted. [ 518.797132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b09ffe5-06c0-410b-acbf-7dd1c8e316b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 519.182714] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d9a2b82-a0af-4991-aa09-08fe272f349c [ 519.182978] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.183128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 519.183199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.183406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 519.183637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 519.183637] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d9a2b82-a0af-4991-aa09-08fe272f349c already deleted. [ 519.183718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d9a2b82-a0af-4991-aa09-08fe272f349c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 520.350824] env[64436]: INFO networking_nsxv3.common.synchronization [None req-c7876b91-e4a9-4345-aa32-4137d9551309 None None] Enqueued Resource ID: b20153e9-7468-4399-b9b1-adee9b796b77 with Priority: HIGHEST for action port [ 520.350824] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20153e9-7468-4399-b9b1-adee9b796b77 with Priority: HIGHEST for action port [ 520.350824] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b20153e9-7468-4399-b9b1-adee9b796b77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.350824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b20153e9-7468-4399-b9b1-adee9b796b77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 520.350824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b20153e9-7468-4399-b9b1-adee9b796b77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 520.350824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b20153e9-7468-4399-b9b1-adee9b796b77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 520.350824] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b20153e9-7468-4399-b9b1-adee9b796b77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 520.591137] env[64436]: INFO networking_nsxv3.common.synchronization [None req-6093d93b-57fd-4913-b54b-3e0aa35d6e88 tempest-ServersV294TestFqdnHostnames-1324617988 tempest-ServersV294TestFqdnHostnames-1324617988-project-member] Enqueued Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_rules [ 520.591527] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_rules [ 520.591705] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.591933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 520.591933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 520.592182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 520.592269] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 520.852890] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b20153e9-7468-4399-b9b1-adee9b796b77 [ 520.853151] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.853302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 520.853349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 520.853981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 520.853981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 520.853981] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b20153e9-7468-4399-b9b1-adee9b796b77 already deleted. [ 520.853981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b20153e9-7468-4399-b9b1-adee9b796b77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 520.997078] env[64436]: INFO networking_nsxv3.common.synchronization [None req-74211672-25be-46bd-a169-a406204007b3 tempest-ServersV294TestFqdnHostnames-1324617988 tempest-ServersV294TestFqdnHostnames-1324617988-project-member] Enqueued Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_rules [ 520.997078] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_rules [ 520.997078] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 520.997078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 521.097602] env[64436]: INFO networking_nsxv3.common.synchronization [None req-1b05facb-b583-40fa-ab11-30d639b94be7 None None] Enqueued Resource ID: c5b95b09-48b6-4ac5-905c-a3a7e0a1232f with Priority: HIGHEST for action port [ 521.098476] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b95b09-48b6-4ac5-905c-a3a7e0a1232f with Priority: HIGHEST for action port [ 521.099604] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5b95b09-48b6-4ac5-905c-a3a7e0a1232f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.099604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5b95b09-48b6-4ac5-905c-a3a7e0a1232f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 521.099604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5b95b09-48b6-4ac5-905c-a3a7e0a1232f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 521.099758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5b95b09-48b6-4ac5-905c-a3a7e0a1232f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 521.099789] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b95b09-48b6-4ac5-905c-a3a7e0a1232f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.117643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.117643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 521.117643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 521.117643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 521.117643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 521.117643] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 already deleted. [ 521.117643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 521.117643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 521.117643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 521.121635] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.414056] env[64436]: INFO networking_nsxv3.common.synchronization [None req-77c8c0d6-595a-4908-8061-c7f6adeafbf5 None None] Enqueued Resource ID: d5ff584d-8bce-4974-8242-0a865c426108 with Priority: HIGHEST for action port [ 521.414415] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ff584d-8bce-4974-8242-0a865c426108 with Priority: HIGHEST for action port [ 521.414908] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5ff584d-8bce-4974-8242-0a865c426108 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.415117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5ff584d-8bce-4974-8242-0a865c426108" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 521.415117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5ff584d-8bce-4974-8242-0a865c426108" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 521.415386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5ff584d-8bce-4974-8242-0a865c426108" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 521.415482] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5ff584d-8bce-4974-8242-0a865c426108',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.602524] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5b95b09-48b6-4ac5-905c-a3a7e0a1232f [ 521.607017] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.607017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 521.607017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 521.607017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 521.607017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 521.607017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5b95b09-48b6-4ac5-905c-a3a7e0a1232f already deleted. [ 521.607017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5b95b09-48b6-4ac5-905c-a3a7e0a1232f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 521.641140] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.641406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 521.641406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 521.641616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 521.641684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 521.641765] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 already deleted. [ 521.642240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 521.920752] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5ff584d-8bce-4974-8242-0a865c426108 [ 521.921119] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.921359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 521.921710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 521.921985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 521.922236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 521.922453] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5ff584d-8bce-4974-8242-0a865c426108 already deleted. [ 521.922453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5ff584d-8bce-4974-8242-0a865c426108" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 523.141517] env[64436]: INFO networking_nsxv3.common.synchronization [None req-2ccc3ccb-66d6-40d6-9cef-2af5239f365c None None] Enqueued Resource ID: ddccd3f0-3333-4f7f-8491-d5ce93471e3f with Priority: HIGHEST for action port [ 523.142051] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddccd3f0-3333-4f7f-8491-d5ce93471e3f with Priority: HIGHEST for action port [ 523.143563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddccd3f0-3333-4f7f-8491-d5ce93471e3f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.143563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddccd3f0-3333-4f7f-8491-d5ce93471e3f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 523.143681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddccd3f0-3333-4f7f-8491-d5ce93471e3f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.144533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddccd3f0-3333-4f7f-8491-d5ce93471e3f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 523.144648] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddccd3f0-3333-4f7f-8491-d5ce93471e3f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.290598] env[64436]: INFO networking_nsxv3.common.synchronization [None req-46098c64-87de-498d-a29a-52adf2179c5c None None] Enqueued Resource ID: 647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4 with Priority: HIGHEST for action port [ 523.291172] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4 with Priority: HIGHEST for action port [ 523.291446] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.291605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 523.291640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.292609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 523.292729] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.646925] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddccd3f0-3333-4f7f-8491-d5ce93471e3f [ 523.647874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.648201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 523.648273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.648486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 523.648574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 523.648667] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddccd3f0-3333-4f7f-8491-d5ce93471e3f already deleted. [ 523.648748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddccd3f0-3333-4f7f-8491-d5ce93471e3f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 523.795650] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4 [ 523.795863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.795945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 523.796053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.796283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 523.797270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 523.797398] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4 already deleted. [ 523.797494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-647a36bb-8ad8-47f8-acf7-c0a0b7a52fd4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 523.935059] env[64436]: INFO networking_nsxv3.common.synchronization [None req-eafa6b9f-d063-4acb-9ba2-8b70a4168dbd None None] Enqueued Resource ID: 6a20afaa-dc76-408a-944b-c96de997b518 with Priority: HIGHEST for action port [ 523.935578] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a20afaa-dc76-408a-944b-c96de997b518 with Priority: HIGHEST for action port [ 523.936612] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a20afaa-dc76-408a-944b-c96de997b518 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.936744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a20afaa-dc76-408a-944b-c96de997b518" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 523.936814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a20afaa-dc76-408a-944b-c96de997b518" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.937090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a20afaa-dc76-408a-944b-c96de997b518" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 523.937170] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a20afaa-dc76-408a-944b-c96de997b518',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.144808] env[64436]: INFO networking_nsxv3.common.synchronization [None req-cae4b092-1242-4d02-9fa9-45b0112c8f38 None None] Enqueued Resource ID: a8c21725-eb4e-40d8-8e97-2a3ebbc9c707 with Priority: HIGHEST for action port [ 524.145129] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c21725-eb4e-40d8-8e97-2a3ebbc9c707 with Priority: HIGHEST for action port [ 524.145840] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8c21725-eb4e-40d8-8e97-2a3ebbc9c707 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.146071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8c21725-eb4e-40d8-8e97-2a3ebbc9c707" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 524.146140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8c21725-eb4e-40d8-8e97-2a3ebbc9c707" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.146488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8c21725-eb4e-40d8-8e97-2a3ebbc9c707" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 524.146617] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8c21725-eb4e-40d8-8e97-2a3ebbc9c707',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.306502] env[64436]: INFO networking_nsxv3.common.synchronization [None req-7d1ae748-c822-4ed6-9713-f5aa61bba958 None None] Enqueued Resource ID: bc043e28-895b-4358-a6ae-343e54bff977 with Priority: HIGHEST for action port [ 524.306831] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc043e28-895b-4358-a6ae-343e54bff977 with Priority: HIGHEST for action port [ 524.307500] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc043e28-895b-4358-a6ae-343e54bff977 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.307650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc043e28-895b-4358-a6ae-343e54bff977" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 524.307737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc043e28-895b-4358-a6ae-343e54bff977" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.308012] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc043e28-895b-4358-a6ae-343e54bff977" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 524.308097] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc043e28-895b-4358-a6ae-343e54bff977',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.441130] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a20afaa-dc76-408a-944b-c96de997b518 [ 524.441322] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.441445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 524.441530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.441899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 524.441899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 524.443314] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a20afaa-dc76-408a-944b-c96de997b518 already deleted. [ 524.443314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a20afaa-dc76-408a-944b-c96de997b518" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 524.635971] env[64436]: INFO networking_nsxv3.common.synchronization [None req-6f6a8368-d3c7-4d1d-b580-b8039becb65c None None] Enqueued Resource ID: b0ed4302-698c-434f-bfb5-99a3eafe674c with Priority: HIGHEST for action port [ 524.636710] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0ed4302-698c-434f-bfb5-99a3eafe674c with Priority: HIGHEST for action port [ 524.637519] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0ed4302-698c-434f-bfb5-99a3eafe674c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.637759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0ed4302-698c-434f-bfb5-99a3eafe674c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 524.637759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0ed4302-698c-434f-bfb5-99a3eafe674c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.638074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0ed4302-698c-434f-bfb5-99a3eafe674c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 524.639532] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ed4302-698c-434f-bfb5-99a3eafe674c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.649982] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8c21725-eb4e-40d8-8e97-2a3ebbc9c707 [ 524.650347] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.651041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 524.651109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.651403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 524.651476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 524.651701] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8c21725-eb4e-40d8-8e97-2a3ebbc9c707 already deleted. [ 524.651701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8c21725-eb4e-40d8-8e97-2a3ebbc9c707" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 524.812407] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc043e28-895b-4358-a6ae-343e54bff977 [ 524.812638] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.812792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 524.812834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.813165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 524.813294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 524.813398] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc043e28-895b-4358-a6ae-343e54bff977 already deleted. [ 524.813480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc043e28-895b-4358-a6ae-343e54bff977" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 525.142810] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0ed4302-698c-434f-bfb5-99a3eafe674c [ 525.143128] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.143282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 525.143342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.144348] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 525.144457] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 525.144564] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0ed4302-698c-434f-bfb5-99a3eafe674c already deleted. [ 525.144651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0ed4302-698c-434f-bfb5-99a3eafe674c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 525.915750] env[64436]: INFO networking_nsxv3.common.synchronization [None req-0c2ece8e-be13-48be-9ca0-abb86ef437d7 None None] Enqueued Resource ID: 2adcf50d-29ea-4998-8e33-2965b3ded4cb with Priority: HIGHEST for action port [ 525.915999] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2adcf50d-29ea-4998-8e33-2965b3ded4cb with Priority: HIGHEST for action port [ 525.916585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2adcf50d-29ea-4998-8e33-2965b3ded4cb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.916711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2adcf50d-29ea-4998-8e33-2965b3ded4cb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 525.916780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2adcf50d-29ea-4998-8e33-2965b3ded4cb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.917179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2adcf50d-29ea-4998-8e33-2965b3ded4cb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 525.917285] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2adcf50d-29ea-4998-8e33-2965b3ded4cb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.977510] env[64436]: INFO networking_nsxv3.common.synchronization [None req-6c016a7c-aa78-4aff-ad60-0c7034425359 None None] Enqueued Resource ID: 9a92f9b2-0711-4bb5-9887-764d23def31f with Priority: HIGHEST for action port [ 525.978067] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a92f9b2-0711-4bb5-9887-764d23def31f with Priority: HIGHEST for action port [ 525.978590] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a92f9b2-0711-4bb5-9887-764d23def31f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.978590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a92f9b2-0711-4bb5-9887-764d23def31f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 525.978590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a92f9b2-0711-4bb5-9887-764d23def31f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.978897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a92f9b2-0711-4bb5-9887-764d23def31f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 525.978986] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a92f9b2-0711-4bb5-9887-764d23def31f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.421336] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2adcf50d-29ea-4998-8e33-2965b3ded4cb [ 526.422091] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.422091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 526.422091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.422091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 526.422264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 526.422313] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2adcf50d-29ea-4998-8e33-2965b3ded4cb already deleted. [ 526.422392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2adcf50d-29ea-4998-8e33-2965b3ded4cb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 526.486458] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a92f9b2-0711-4bb5-9887-764d23def31f [ 526.486458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.486458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 526.486458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.486458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 526.486458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 526.486458] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a92f9b2-0711-4bb5-9887-764d23def31f already deleted. [ 526.486458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a92f9b2-0711-4bb5-9887-764d23def31f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 527.325440] env[64436]: INFO networking_nsxv3.common.synchronization [None req-913527d8-8e1d-4068-9ffb-b0d679170250 None None] Enqueued Resource ID: 2afaab01-d90b-4f25-9aba-b0ded5d80cb5 with Priority: HIGHEST for action port [ 527.326026] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2afaab01-d90b-4f25-9aba-b0ded5d80cb5 with Priority: HIGHEST for action port [ 527.326347] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2afaab01-d90b-4f25-9aba-b0ded5d80cb5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.326466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2afaab01-d90b-4f25-9aba-b0ded5d80cb5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 527.326538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2afaab01-d90b-4f25-9aba-b0ded5d80cb5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.326788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2afaab01-d90b-4f25-9aba-b0ded5d80cb5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 527.326872] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2afaab01-d90b-4f25-9aba-b0ded5d80cb5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.440297] env[64436]: INFO networking_nsxv3.common.synchronization [None req-136a0aa0-6d36-4566-8a93-0380e125b84e None None] Enqueued Resource ID: bb060500-4fc9-443d-a1a9-cfc2079f928b with Priority: HIGHEST for action port [ 527.440564] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb060500-4fc9-443d-a1a9-cfc2079f928b with Priority: HIGHEST for action port [ 527.442146] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb060500-4fc9-443d-a1a9-cfc2079f928b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.442146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb060500-4fc9-443d-a1a9-cfc2079f928b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 527.442403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb060500-4fc9-443d-a1a9-cfc2079f928b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.442984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb060500-4fc9-443d-a1a9-cfc2079f928b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 527.443073] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb060500-4fc9-443d-a1a9-cfc2079f928b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.831783] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2afaab01-d90b-4f25-9aba-b0ded5d80cb5 [ 527.831783] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.831783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 527.831783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.832177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 527.832451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 527.832801] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2afaab01-d90b-4f25-9aba-b0ded5d80cb5 already deleted. [ 527.833044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2afaab01-d90b-4f25-9aba-b0ded5d80cb5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 527.947629] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb060500-4fc9-443d-a1a9-cfc2079f928b [ 527.947629] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.947629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 527.947629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.947629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 527.947629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 527.947629] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb060500-4fc9-443d-a1a9-cfc2079f928b already deleted. [ 527.947629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb060500-4fc9-443d-a1a9-cfc2079f928b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 528.953020] env[64436]: INFO networking_nsxv3.common.synchronization [None req-bd80db75-6838-466e-aadf-4bb309d3c9fd tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_rules [ 528.953582] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_rules [ 528.953908] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.954417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 528.954536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.954925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 528.954925] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.143226] env[64436]: INFO networking_nsxv3.common.synchronization [None req-0c451e89-ce2d-4b26-8f8d-f7fe7af528a8 None None] Enqueued Resource ID: 99f8c852-43f9-42cd-8ee6-6bccdcf12a33 with Priority: HIGHEST for action port [ 529.144028] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99f8c852-43f9-42cd-8ee6-6bccdcf12a33 with Priority: HIGHEST for action port [ 529.144354] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-99f8c852-43f9-42cd-8ee6-6bccdcf12a33 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.144499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99f8c852-43f9-42cd-8ee6-6bccdcf12a33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 529.144580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99f8c852-43f9-42cd-8ee6-6bccdcf12a33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.145069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99f8c852-43f9-42cd-8ee6-6bccdcf12a33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 529.145069] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f8c852-43f9-42cd-8ee6-6bccdcf12a33',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.183326] env[64436]: INFO networking_nsxv3.common.synchronization [None req-0f515ab4-66c9-4885-87bc-1f876af2334b tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_rules [ 529.183326] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_rules [ 529.183326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.183326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 529.384104] env[64436]: INFO networking_nsxv3.common.synchronization [None req-39857142-6d60-4c7d-a697-55402289a27f None None] Enqueued Resource ID: 97208631-894e-4188-a7e8-9734802ef9f0 with Priority: HIGHEST for action port [ 529.384104] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97208631-894e-4188-a7e8-9734802ef9f0 with Priority: HIGHEST for action port [ 529.384104] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-97208631-894e-4188-a7e8-9734802ef9f0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.384104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97208631-894e-4188-a7e8-9734802ef9f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 529.384104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97208631-894e-4188-a7e8-9734802ef9f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.384104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97208631-894e-4188-a7e8-9734802ef9f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 529.384104] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97208631-894e-4188-a7e8-9734802ef9f0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.477551] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.477717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 529.477717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.477997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 529.477997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 529.478362] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab78b72f-7655-492a-8135-613a26cfa217 already deleted. [ 529.478687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 529.478687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.478789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 529.478873] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.648666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99f8c852-43f9-42cd-8ee6-6bccdcf12a33 [ 529.648666] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.648666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 529.648666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.648666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 529.648666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 529.648666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99f8c852-43f9-42cd-8ee6-6bccdcf12a33 already deleted. [ 529.648666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99f8c852-43f9-42cd-8ee6-6bccdcf12a33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 529.761307] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f6f0cdc8-e620-4930-a741-a1eaefdb193f None None] Enqueued Resource ID: 1818b968-1873-4516-a81f-f3e7d4366985 with Priority: HIGHEST for action port [ 529.761945] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1818b968-1873-4516-a81f-f3e7d4366985 with Priority: HIGHEST for action port [ 529.762533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1818b968-1873-4516-a81f-f3e7d4366985 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.762533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1818b968-1873-4516-a81f-f3e7d4366985" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 529.762533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1818b968-1873-4516-a81f-f3e7d4366985" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.763228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1818b968-1873-4516-a81f-f3e7d4366985" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 529.763228] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1818b968-1873-4516-a81f-f3e7d4366985',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.886177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97208631-894e-4188-a7e8-9734802ef9f0 [ 529.886471] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.886610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 529.886680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.886926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 529.886987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 529.887087] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97208631-894e-4188-a7e8-9734802ef9f0 already deleted. [ 529.887215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97208631-894e-4188-a7e8-9734802ef9f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 530.006873] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.007236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 530.007236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.007319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 530.008282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 530.008282] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab78b72f-7655-492a-8135-613a26cfa217 already deleted. [ 530.008282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 530.266131] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1818b968-1873-4516-a81f-f3e7d4366985 [ 530.266399] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.267099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 530.267099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.267099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 530.267099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 530.267099] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1818b968-1873-4516-a81f-f3e7d4366985 already deleted. [ 530.267335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1818b968-1873-4516-a81f-f3e7d4366985" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 530.465993] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f9424309-79cd-409c-9770-d99cf0b0fc01 None None] Enqueued Resource ID: e6a9ab2f-5a58-4ea4-a74c-fe65075996db with Priority: HIGHEST for action port [ 530.466650] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a9ab2f-5a58-4ea4-a74c-fe65075996db with Priority: HIGHEST for action port [ 530.467926] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6a9ab2f-5a58-4ea4-a74c-fe65075996db taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.467926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6a9ab2f-5a58-4ea4-a74c-fe65075996db" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 530.467926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6a9ab2f-5a58-4ea4-a74c-fe65075996db" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.468785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6a9ab2f-5a58-4ea4-a74c-fe65075996db" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 530.468785] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6a9ab2f-5a58-4ea4-a74c-fe65075996db',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.972811] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6a9ab2f-5a58-4ea4-a74c-fe65075996db [ 530.973583] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.973583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 530.973583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.973844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 530.973969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 530.974108] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6a9ab2f-5a58-4ea4-a74c-fe65075996db already deleted. [ 530.974227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6a9ab2f-5a58-4ea4-a74c-fe65075996db" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 531.849693] env[64436]: INFO networking_nsxv3.common.synchronization [None req-5d7f646f-9ff4-4508-803b-f383670932b0 None None] Enqueued Resource ID: 05f37cd6-ab4f-4afa-8c07-22c2e2109452 with Priority: HIGHEST for action port [ 531.850435] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05f37cd6-ab4f-4afa-8c07-22c2e2109452 with Priority: HIGHEST for action port [ 531.850592] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-05f37cd6-ab4f-4afa-8c07-22c2e2109452 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 531.850717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05f37cd6-ab4f-4afa-8c07-22c2e2109452" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 531.850788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05f37cd6-ab4f-4afa-8c07-22c2e2109452" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 531.851659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05f37cd6-ab4f-4afa-8c07-22c2e2109452" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 531.851785] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05f37cd6-ab4f-4afa-8c07-22c2e2109452',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 532.356675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05f37cd6-ab4f-4afa-8c07-22c2e2109452 [ 532.356970] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.357191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 532.357275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.357590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 532.357692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 532.357791] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05f37cd6-ab4f-4afa-8c07-22c2e2109452 already deleted. [ 532.357874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05f37cd6-ab4f-4afa-8c07-22c2e2109452" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 533.035955] env[64436]: INFO networking_nsxv3.common.synchronization [req-2ad63543-7770-45db-bb79-d8e00a2024d7 req-58168374-7a57-4f25-ab43-30bae73580f2 tempest-ServersV294TestFqdnHostnames-1324617988 tempest-ServersV294TestFqdnHostnames-1324617988-project-member] Enqueued Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_members [ 533.036770] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_members [ 533.037274] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.037533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 533.037533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.038193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 533.038417] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.038887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 533.039013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.039258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 533.039381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 533.039518] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.545028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 533.545028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 533.545028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 already deleted. [ 533.545028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.263647] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.263647] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-615" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.263647] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-615" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.263647] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-615" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.264340] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.264574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.264751] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.265048] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.265449] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.265813] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 534.265988] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 534.266246] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 534.266425] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 534.266676] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 534.266743] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 534.267030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 534.286847] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 534.286969] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 534.287121] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 534.287364] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-615" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.287665] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-11f5810f-e245-487c-9420-19c11ee8964c taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.287915] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.288032] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.290984] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.290984] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f5810f-e245-487c-9420-19c11ee8964c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.792235] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.792491] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.792685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.792965] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.793115] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.793258] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 11f5810f-e245-487c-9420-19c11ee8964c not found, creating... [ 534.793548] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.793709] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.793830] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.794673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.794673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.796532] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.796532] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.796700] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.797020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.797020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.797126] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 11f5810f-e245-487c-9420-19c11ee8964c is going to be created. [ 534.817704] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.817910] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.818156] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.818325] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.818559] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.818785] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 534.867861] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f0d0a6c5-a285-4582-8ba8-cf9ec6c550f6 None None] Enqueued Resource ID: a5e302f1-de21-41a4-a73a-303564102ae8 with Priority: HIGHEST for action port [ 534.868489] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5e302f1-de21-41a4-a73a-303564102ae8 with Priority: HIGHEST for action port [ 534.868801] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5e302f1-de21-41a4-a73a-303564102ae8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.868929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5e302f1-de21-41a4-a73a-303564102ae8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 534.869015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5e302f1-de21-41a4-a73a-303564102ae8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.870158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5e302f1-de21-41a4-a73a-303564102ae8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 534.870275] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e302f1-de21-41a4-a73a-303564102ae8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 535.122365] env[64436]: INFO networking_nsxv3.common.synchronization [req-4cb4fee6-c66e-4d48-be37-d4a1b476ba35 req-a0defa59-c7b2-41c4-9cd6-806b9bd901bf tempest-ServersAdminNegativeTestJSON-837803547 tempest-ServersAdminNegativeTestJSON-837803547-project-member] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 535.123513] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 535.123513] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.123513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 535.123513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.123693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 535.123858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.123917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 535.123978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.124122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 535.124228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 535.124300] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 535.374159] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5e302f1-de21-41a4-a73a-303564102ae8 [ 535.374428] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.374522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 535.375040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.375040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 535.375040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 535.375040] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5e302f1-de21-41a4-a73a-303564102ae8 already deleted. [ 535.375313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5e302f1-de21-41a4-a73a-303564102ae8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 535.627682] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.627839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 535.627915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.628153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 535.628240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 535.628494] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.628562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 535.628650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.629720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 535.629720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 535.629720] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7502962-276d-43f0-96f0-2447f12d3137 already deleted. [ 535.629720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.310190] env[64436]: INFO networking_nsxv3.common.synchronization [req-2ad63543-7770-45db-bb79-d8e00a2024d7 req-de6f9e5d-fc14-4b90-b1d9-cad18d9bb58e service nova] Enqueued Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_rules [ 536.310983] env[64436]: INFO networking_nsxv3.common.synchronization [req-2ad63543-7770-45db-bb79-d8e00a2024d7 req-de6f9e5d-fc14-4b90-b1d9-cad18d9bb58e service nova] Enqueued Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_members [ 536.310983] env[64436]: INFO networking_nsxv3.common.synchronization [req-2ad63543-7770-45db-bb79-d8e00a2024d7 req-de6f9e5d-fc14-4b90-b1d9-cad18d9bb58e service nova] Enqueued Resource ID: 11f5810f-e245-487c-9420-19c11ee8964c with Priority: HIGHEST for action port [ 536.310983] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_rules [ 536.310983] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_members [ 536.310983] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f5810f-e245-487c-9420-19c11ee8964c with Priority: HIGHEST for action port [ 536.311795] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.311919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.312013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.312517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.312606] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.313860] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.313972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.314073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.314263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.314374] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.314541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.314541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.314662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.314751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.314840] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.317397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-11f5810f-e245-487c-9420-19c11ee8964c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.317503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.317571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.317724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.317800] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f5810f-e245-487c-9420-19c11ee8964c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.336085] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ddb69726-bf0f-4bd1-8f74-ad9127f3ef8c None None] Enqueued Resource ID: e7db3cf0-c88b-4d69-be3f-711b6305e2ca with Priority: HIGHEST for action port [ 536.339285] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7db3cf0-c88b-4d69-be3f-711b6305e2ca with Priority: HIGHEST for action port [ 536.339285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7db3cf0-c88b-4d69-be3f-711b6305e2ca taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.339285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7db3cf0-c88b-4d69-be3f-711b6305e2ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.339285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7db3cf0-c88b-4d69-be3f-711b6305e2ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.339285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7db3cf0-c88b-4d69-be3f-711b6305e2ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.339285] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7db3cf0-c88b-4d69-be3f-711b6305e2ca',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.492463] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f8ef6767-627d-4b11-9626-1a002acea88a None None] Enqueued Resource ID: 4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0 with Priority: HIGHEST for action port [ 536.493425] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0 with Priority: HIGHEST for action port [ 536.493503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.493609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.494152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.495821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.495821] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.719110] env[64436]: INFO networking_nsxv3.common.synchronization [None req-167bb40e-22a7-41cd-8b01-0f1870e20a6e None None] Enqueued Resource ID: 046fd425-8672-48f7-b717-6f9ca01da1d8 with Priority: HIGHEST for action port [ 536.719375] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046fd425-8672-48f7-b717-6f9ca01da1d8 with Priority: HIGHEST for action port [ 536.719961] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-046fd425-8672-48f7-b717-6f9ca01da1d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.720328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-046fd425-8672-48f7-b717-6f9ca01da1d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.720328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-046fd425-8672-48f7-b717-6f9ca01da1d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.725515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-046fd425-8672-48f7-b717-6f9ca01da1d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.725515] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('046fd425-8672-48f7-b717-6f9ca01da1d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.804125] env[64436]: INFO networking_nsxv3.common.synchronization [None req-a7b3438f-e8d4-452a-80eb-805c56de987f None None] Enqueued Resource ID: bd98cbd0-6902-47d3-81e3-0b5debec61c6 with Priority: HIGHEST for action port [ 536.804125] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd98cbd0-6902-47d3-81e3-0b5debec61c6 with Priority: HIGHEST for action port [ 536.804125] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd98cbd0-6902-47d3-81e3-0b5debec61c6 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.804125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd98cbd0-6902-47d3-81e3-0b5debec61c6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.804125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd98cbd0-6902-47d3-81e3-0b5debec61c6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.804125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd98cbd0-6902-47d3-81e3-0b5debec61c6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.804125] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd98cbd0-6902-47d3-81e3-0b5debec61c6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.814290] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.814398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.817742] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.819126] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11f5810f-e245-487c-9420-19c11ee8964c with status ACTIVE [ 536.819345] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.819465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.820219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.820565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.820762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.821203] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.821933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.821933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.822291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.822417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.822901] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.822901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.823146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.823262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.823293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.823500] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11f5810f-e245-487c-9420-19c11ee8964c is going to be updated. [ 536.840221] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7db3cf0-c88b-4d69-be3f-711b6305e2ca [ 536.840544] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.840657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.840657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.840811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.840897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.840995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7db3cf0-c88b-4d69-be3f-711b6305e2ca already deleted. [ 536.841112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7db3cf0-c88b-4d69-be3f-711b6305e2ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.845616] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.845750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.845827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.846032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.846335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.846335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11f5810f-e245-487c-9420-19c11ee8964c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.997352] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0 [ 536.997758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.998691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 536.998691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.998691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 536.998691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 536.998691] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0 already deleted. [ 536.998691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e8a4a81-68e0-4ef1-a297-5c1a2d9548f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.197952] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.198155] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.198276] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.198597] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.199418] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.199418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.199418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.203314] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.203555] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.203695] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 537.203810] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 537.203926] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 537.204046] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 537.204160] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 537.204269] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 537.204452] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 537.222774] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 537.224074] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 537.224074] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 537.224074] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.224074] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-fcdfadbd-8f84-40ab-a53a-993831aeba48 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.224074] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.224074] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.224445] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.224445] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcdfadbd-8f84-40ab-a53a-993831aeba48',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.226999] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 046fd425-8672-48f7-b717-6f9ca01da1d8 [ 537.226999] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.227150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.227150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.227424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.227424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.227486] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:046fd425-8672-48f7-b717-6f9ca01da1d8 already deleted. [ 537.227560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-046fd425-8672-48f7-b717-6f9ca01da1d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.307528] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd98cbd0-6902-47d3-81e3-0b5debec61c6 [ 537.307767] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.307901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.307971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.308208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.308295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.308592] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd98cbd0-6902-47d3-81e3-0b5debec61c6 already deleted. [ 537.308726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd98cbd0-6902-47d3-81e3-0b5debec61c6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.320199] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.484951] env[64436]: INFO networking_nsxv3.common.synchronization [req-29b6cd48-1308-4dd3-bfed-98f09a8e61bb req-419419f2-7ae9-4cf1-a6eb-90a55f2688c6 tempest-DeleteServersAdminTestJSON-48215762 tempest-DeleteServersAdminTestJSON-48215762-project-member] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 537.485549] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 537.485837] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.485950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.486204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.486566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.486830] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.486938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.487156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.487436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.487532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.487787] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.726522] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.726522] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.726924] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.726924] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.727008] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.727162] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port fcdfadbd-8f84-40ab-a53a-993831aeba48 not found, creating... [ 537.728407] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.728650] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.728809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.729603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.729603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.729603] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.730501] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.730501] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.730501] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.730501] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.730501] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: fcdfadbd-8f84-40ab-a53a-993831aeba48 is going to be created. [ 537.752066] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.752066] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.752066] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.752512] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.752757] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.752968] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.823504] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.823885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.823989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.824303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.824431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.824555] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 is going to be created. [ 537.858234] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.858413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.858603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.858652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.858831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.869159] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 in Status: UNINITIALIZED for 2s [ 537.991803] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.991803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.991803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.992120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.992120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.992319] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.992319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 537.992440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.992523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 537.992594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 537.992679] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 already deleted. [ 537.992759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.221267] env[64436]: INFO networking_nsxv3.common.synchronization [None req-1a449ace-63c4-4999-b162-7ede5ac226b3 None None] Enqueued Resource ID: c0e4547f-9880-492d-b1b5-1fda3ea78dbc with Priority: HIGHEST for action port [ 539.221267] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0e4547f-9880-492d-b1b5-1fda3ea78dbc with Priority: HIGHEST for action port [ 539.222672] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0e4547f-9880-492d-b1b5-1fda3ea78dbc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.223079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0e4547f-9880-492d-b1b5-1fda3ea78dbc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.223634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0e4547f-9880-492d-b1b5-1fda3ea78dbc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.224141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0e4547f-9880-492d-b1b5-1fda3ea78dbc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.224383] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0e4547f-9880-492d-b1b5-1fda3ea78dbc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.250606] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.250606] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.250606] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.250606] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.250606] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.250606] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.250606] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.251484] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.251809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.252220] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 539.252477] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 539.252729] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 539.252930] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 539.253293] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 539.253511] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 539.253727] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 539.275297] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 539.275297] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 539.275297] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 539.275297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.275297] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-c2615876-79eb-4641-a581-4f0c860c0a44 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.275297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.275297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.275297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.275297] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2615876-79eb-4641-a581-4f0c860c0a44',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.325099] env[64436]: INFO networking_nsxv3.common.synchronization [req-4cb4fee6-c66e-4d48-be37-d4a1b476ba35 req-764c79fb-e770-4649-9584-eb0f6450df83 service nova] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_rules [ 539.325269] env[64436]: INFO networking_nsxv3.common.synchronization [req-4cb4fee6-c66e-4d48-be37-d4a1b476ba35 req-764c79fb-e770-4649-9584-eb0f6450df83 service nova] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 539.325400] env[64436]: INFO networking_nsxv3.common.synchronization [req-4cb4fee6-c66e-4d48-be37-d4a1b476ba35 req-764c79fb-e770-4649-9584-eb0f6450df83 service nova] Enqueued Resource ID: fcdfadbd-8f84-40ab-a53a-993831aeba48 with Priority: HIGHEST for action port [ 539.326491] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_rules [ 539.326652] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 539.327097] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdfadbd-8f84-40ab-a53a-993831aeba48 with Priority: HIGHEST for action port [ 539.328015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.328154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.328227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.328470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.328766] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.329836] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.330037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.330119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.330402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.330570] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.330672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.330750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.330987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.330987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.331225] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.332806] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcdfadbd-8f84-40ab-a53a-993831aeba48 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.332806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.332806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.332806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.332806] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcdfadbd-8f84-40ab-a53a-993831aeba48',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.471908] env[64436]: INFO networking_nsxv3.common.synchronization [None req-26656f48-efd7-4441-95e3-22cd543eedc6 None None] Enqueued Resource ID: 6414bc2f-8ff0-4fb2-9229-33aabbf46a9c with Priority: HIGHEST for action port [ 539.472928] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6414bc2f-8ff0-4fb2-9229-33aabbf46a9c with Priority: HIGHEST for action port [ 539.473317] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6414bc2f-8ff0-4fb2-9229-33aabbf46a9c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.473444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6414bc2f-8ff0-4fb2-9229-33aabbf46a9c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.473515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6414bc2f-8ff0-4fb2-9229-33aabbf46a9c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.473773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6414bc2f-8ff0-4fb2-9229-33aabbf46a9c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.473872] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6414bc2f-8ff0-4fb2-9229-33aabbf46a9c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.732108] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0e4547f-9880-492d-b1b5-1fda3ea78dbc [ 539.732108] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.732108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.732108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.732108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.732108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.734086] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0e4547f-9880-492d-b1b5-1fda3ea78dbc already deleted. [ 539.734086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0e4547f-9880-492d-b1b5-1fda3ea78dbc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.778606] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.778845] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.778975] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.779303] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.779458] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.779618] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port c2615876-79eb-4641-a581-4f0c860c0a44 not found, creating... [ 539.779885] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.780064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.780188] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.780451] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.780546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.780874] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.781032] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.781230] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.781415] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.781602] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.781934] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: c2615876-79eb-4641-a581-4f0c860c0a44 is going to be created. [ 539.804427] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.804427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.804427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.804427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.804427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.804427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.835992] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.836155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.850061] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcdfadbd-8f84-40ab-a53a-993831aeba48 with status ACTIVE [ 539.850061] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.850061] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.850061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.850597] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.850597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.850597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.850597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.850597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.850597] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcdfadbd-8f84-40ab-a53a-993831aeba48 is going to be updated. [ 539.851786] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.877342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.877342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.877342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.877342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.877342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.877342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcdfadbd-8f84-40ab-a53a-993831aeba48" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.886926] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 in Status: SUCCESS [ 539.887176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.887331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.887581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.887750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.887868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.887933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.888108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.888190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.888276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.888366] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.977585] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6414bc2f-8ff0-4fb2-9229-33aabbf46a9c [ 539.977585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.977585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 539.977585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.977585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 539.977585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 539.977585] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6414bc2f-8ff0-4fb2-9229-33aabbf46a9c already deleted. [ 539.977585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6414bc2f-8ff0-4fb2-9229-33aabbf46a9c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.237419] env[64436]: INFO networking_nsxv3.common.synchronization [req-906f2e09-faa4-4e29-8479-bb80c0e94a5a req-7170f4be-7d49-40a0-ba75-173c9d7b921a tempest-ServerDiagnosticsTest-544626028 tempest-ServerDiagnosticsTest-544626028-project-member] Enqueued Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_members [ 540.238714] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_members [ 540.239557] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.239871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.240690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.241052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.241321] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.241597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.241754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.242116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.242289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.242742] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 540.356913] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 540.392754] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 540.748172] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.748172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.748172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.748438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.748484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.748811] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.748811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.748905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.749506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.749506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.749506] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a already deleted. [ 540.749506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.796834] env[64436]: INFO networking_nsxv3.common.synchronization [None req-7a2ad436-cda1-4d98-94b2-a86a1bec7d7b None None] Enqueued Resource ID: a3b5ef0f-7282-490b-b7b2-343a78bf15b6 with Priority: HIGHEST for action port [ 540.797184] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b5ef0f-7282-490b-b7b2-343a78bf15b6 with Priority: HIGHEST for action port [ 540.797699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3b5ef0f-7282-490b-b7b2-343a78bf15b6 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.797821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3b5ef0f-7282-490b-b7b2-343a78bf15b6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.797885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3b5ef0f-7282-490b-b7b2-343a78bf15b6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.798458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3b5ef0f-7282-490b-b7b2-343a78bf15b6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.798458] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3b5ef0f-7282-490b-b7b2-343a78bf15b6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 540.860245] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.860402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.860460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.860690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.860781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.860880] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7502962-276d-43f0-96f0-2447f12d3137 is going to be created. [ 540.886086] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.886290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.886374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.886593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.886754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.895967] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9: rpc.has_security_group_logging(os_id): False [ 540.897707] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: UNINITIALIZED for 2s [ 540.913901] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.914073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.914120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.914305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.914402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.914671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.914790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 540.914851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.915172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 540.915300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 540.915398] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 is going to be created. [ 541.019665] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.019837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 541.019881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.020181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 541.020454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 541.034227] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 in Status: IN_PROGRESS for 2s [ 541.302020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3b5ef0f-7282-490b-b7b2-343a78bf15b6 [ 541.302020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.302020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 541.302020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.302020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 541.302020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 541.302020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3b5ef0f-7282-490b-b7b2-343a78bf15b6 already deleted. [ 541.302020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3b5ef0f-7282-490b-b7b2-343a78bf15b6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 541.528584] env[64436]: INFO networking_nsxv3.common.synchronization [None req-707cf81c-2fd0-449c-8d9b-1009bb0a7241 None None] Enqueued Resource ID: e3462fd8-5346-4e5b-9dc0-40d73a29358a with Priority: HIGHEST for action port [ 541.528753] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3462fd8-5346-4e5b-9dc0-40d73a29358a with Priority: HIGHEST for action port [ 541.529183] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3462fd8-5346-4e5b-9dc0-40d73a29358a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.529859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3462fd8-5346-4e5b-9dc0-40d73a29358a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 541.529859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3462fd8-5346-4e5b-9dc0-40d73a29358a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.529859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3462fd8-5346-4e5b-9dc0-40d73a29358a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 541.529859] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3462fd8-5346-4e5b-9dc0-40d73a29358a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.795186] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.795414] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 541.795541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.795822] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 541.796090] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.796263] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 541.796414] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.796627] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 541.796768] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 541.796980] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 541.799821] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 541.800013] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 541.800139] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 541.801030] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 541.801152] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 541.801299] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 541.818815] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 541.819072] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 541.819285] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 541.819499] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 541.819852] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-c66177eb-1686-40a1-a08f-0c744f1e6989 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.820087] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 541.820250] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.820623] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 541.820792] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c66177eb-1686-40a1-a08f-0c744f1e6989',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.034122] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3462fd8-5346-4e5b-9dc0-40d73a29358a [ 542.034377] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.034554] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.034611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.034801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.034892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.034990] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3462fd8-5346-4e5b-9dc0-40d73a29358a already deleted. [ 542.035088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3462fd8-5346-4e5b-9dc0-40d73a29358a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.324132] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.324412] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.324515] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.324810] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.324965] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.325175] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port c66177eb-1686-40a1-a08f-0c744f1e6989 not found, creating... [ 542.325507] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.325631] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.325752] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.325999] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.326578] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.326578] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.326578] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.326723] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.326900] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.327043] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.327181] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: c66177eb-1686-40a1-a08f-0c744f1e6989 is going to be created. [ 542.347357] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.347587] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.347714] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.347980] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.348229] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.348662] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.437130] env[64436]: INFO networking_nsxv3.common.synchronization [req-29b6cd48-1308-4dd3-bfed-98f09a8e61bb req-c17ebd60-1c78-4dce-8333-07f14d112cf6 service nova] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_rules [ 542.437416] env[64436]: INFO networking_nsxv3.common.synchronization [req-29b6cd48-1308-4dd3-bfed-98f09a8e61bb req-c17ebd60-1c78-4dce-8333-07f14d112cf6 service nova] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 542.437601] env[64436]: INFO networking_nsxv3.common.synchronization [req-29b6cd48-1308-4dd3-bfed-98f09a8e61bb req-c17ebd60-1c78-4dce-8333-07f14d112cf6 service nova] Enqueued Resource ID: c2615876-79eb-4641-a581-4f0c860c0a44 with Priority: HIGHEST for action port [ 542.439029] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_rules [ 542.439029] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 542.439029] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2615876-79eb-4641-a581-4f0c860c0a44 with Priority: HIGHEST for action port [ 542.439791] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.439791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.439791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.439791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.439987] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.441396] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.441561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.441613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.442771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.442771] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.442771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.442771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.442771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.442771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.442771] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.448363] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2615876-79eb-4641-a581-4f0c860c0a44 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.448363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.448363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.448551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.448551] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2615876-79eb-4641-a581-4f0c860c0a44',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.906868] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: SUCCESS [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.909020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.909020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.909020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.950542] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.950542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.954250] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.955410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2615876-79eb-4641-a581-4f0c860c0a44 with status ACTIVE [ 542.955410] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.955547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.955547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.955735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.955821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.955994] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.956092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.956986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.956986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.956986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.956986] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.956986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.956986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.956986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.956986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.956986] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2615876-79eb-4641-a581-4f0c860c0a44 is going to be updated. [ 542.977308] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.977453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 542.977628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.977725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 542.977887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 542.978022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2615876-79eb-4641-a581-4f0c860c0a44" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.073995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 in Status: SUCCESS [ 543.074356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.144443] env[64436]: INFO networking_nsxv3.common.synchronization [None req-e05a28f1-5f76-49d5-a1bc-fd66f289bd95 None None] Enqueued Resource ID: 4f97c484-2686-40c4-b089-4ae2ac655721 with Priority: HIGHEST for action port [ 543.144604] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f97c484-2686-40c4-b089-4ae2ac655721 with Priority: HIGHEST for action port [ 543.145706] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f97c484-2686-40c4-b089-4ae2ac655721 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.145706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f97c484-2686-40c4-b089-4ae2ac655721" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.145706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f97c484-2686-40c4-b089-4ae2ac655721" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.145706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f97c484-2686-40c4-b089-4ae2ac655721" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.145921] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f97c484-2686-40c4-b089-4ae2ac655721',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.216440] env[64436]: INFO networking_nsxv3.common.synchronization [req-b3bf208d-9437-4d64-812a-4a98c3f54d2f req-630d7539-1c1b-438f-924c-b0198db46077 tempest-ServerExternalEventsTest-600574363 tempest-ServerExternalEventsTest-600574363-project-member] Enqueued Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_members [ 543.216942] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_members [ 543.217248] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1017fee-6833-4760-849a-3861937d36d9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.217365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.217431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.217672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.217821] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.217916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.217972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.218129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.218208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.218302] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.267722] env[64436]: INFO networking_nsxv3.common.synchronization [None req-641ecdd3-e125-440d-865d-a853d7e7e5de tempest-VolumesAssistedSnapshotsTest-817485114 tempest-VolumesAssistedSnapshotsTest-817485114-project-member] Enqueued Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_rules [ 543.271651] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_rules [ 543.272244] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.275036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.275036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.275036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.275036] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.295138] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d0a289e2-8042-4b6e-94ba-4a5548cbfe1d None None] Enqueued Resource ID: 97e595bd-92ff-4481-adde-9d12cef3ada5 with Priority: HIGHEST for action port [ 543.295640] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97e595bd-92ff-4481-adde-9d12cef3ada5 with Priority: HIGHEST for action port [ 543.295940] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-97e595bd-92ff-4481-adde-9d12cef3ada5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.296076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97e595bd-92ff-4481-adde-9d12cef3ada5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.296141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97e595bd-92ff-4481-adde-9d12cef3ada5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.296421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97e595bd-92ff-4481-adde-9d12cef3ada5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.296500] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97e595bd-92ff-4481-adde-9d12cef3ada5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.410584] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.411206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.411206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.411206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.411297] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.411347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.411558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.411558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.411678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.411707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.411852] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.412053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.412053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.412819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.412982] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.413159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.413210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.413353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.413434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.413543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.413606] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.459165] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.647912] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f97c484-2686-40c4-b089-4ae2ac655721 [ 543.650894] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.651063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.651139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.651348] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.651441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.651536] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f97c484-2686-40c4-b089-4ae2ac655721 already deleted. [ 543.651617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f97c484-2686-40c4-b089-4ae2ac655721" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.688224] env[64436]: INFO networking_nsxv3.common.synchronization [None req-7eda1028-a983-47f8-a02e-cf1e4337ead6 tempest-VolumesAssistedSnapshotsTest-817485114 tempest-VolumesAssistedSnapshotsTest-817485114-project-member] Enqueued Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_rules [ 543.688741] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_rules [ 543.689531] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.689531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.720648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.720955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.721138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.721433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.721651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.722952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.722952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.722952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.722952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.722952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.722952] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1017fee-6833-4760-849a-3861937d36d9 already deleted. [ 543.722952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.795795] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.795959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.795998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.796232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.796324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.796418] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 already deleted. [ 543.796504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.797919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.797919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.797919] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.802783] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97e595bd-92ff-4481-adde-9d12cef3ada5 [ 543.802783] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.802783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.802783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.802783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.802783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.802783] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97e595bd-92ff-4481-adde-9d12cef3ada5 already deleted. [ 543.802783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97e595bd-92ff-4481-adde-9d12cef3ada5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.918871] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7502962-276d-43f0-96f0-2447f12d3137: rpc.has_security_group_logging(os_id): False [ 543.936303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.936447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.936544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.936719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.936809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.936990] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.937121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.937171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.937316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.937811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.937811] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.937811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.937811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.938091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.938091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.938634] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.938634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.939485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.939485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.939485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.939485] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7502962-276d-43f0-96f0-2447f12d3137 is going to be created. [ 543.965733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.965733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.965733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.965733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.965733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.965733] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be created. [ 543.985291] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.985443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 543.985517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.985763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 543.985895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 543.994795] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: UNINITIALIZED for 2s [ 544.011451] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.011626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 544.011677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.011878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 544.012156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 544.025197] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: IN_PROGRESS for 2s [ 544.325755] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.326862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 544.332733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.332733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 544.332733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 544.332733] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 already deleted. [ 544.332733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 544.430094] env[64436]: INFO networking_nsxv3.common.synchronization [None req-1309cbc6-db22-42ba-b46f-75d2f52e9b8f tempest-ServersTestFqdnHostnames-248546948 tempest-ServersTestFqdnHostnames-248546948-project-member] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_rules [ 544.430994] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_rules [ 544.431735] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.431971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 544.431971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.432282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 544.432430] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.908482] env[64436]: INFO networking_nsxv3.common.synchronization [None req-faff2609-01f4-4f2a-89de-93fa1914356b tempest-ServersTestFqdnHostnames-248546948 tempest-ServersTestFqdnHostnames-248546948-project-member] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_rules [ 544.909052] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_rules [ 544.912514] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.912514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 544.952668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.952872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 544.952926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.953796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 544.953954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 544.954078] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b966170-3dea-4773-8900-e7034ff19049 already deleted. [ 544.956920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 544.956920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.956920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 544.956920] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.360755] env[64436]: INFO networking_nsxv3.common.synchronization [req-71f6e7c8-f978-445c-b634-7c91a7d855ee req-83061313-1f7b-411d-b0ad-7461948f7aea tempest-FloatingIPsAssociationTestJSON-1278161632 tempest-FloatingIPsAssociationTestJSON-1278161632-project-member] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 545.361284] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 545.361866] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.361994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.362470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.362770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.362967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.363115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.363222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.363413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.363529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.363647] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.482291] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.482291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.482291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.482291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.482291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.482291] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b966170-3dea-4773-8900-e7034ff19049 already deleted. [ 545.482291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.535606] env[64436]: INFO networking_nsxv3.common.synchronization [req-906f2e09-faa4-4e29-8479-bb80c0e94a5a req-4453af62-ef1a-4278-8a84-b9ed665dee79 service nova] Enqueued Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_rules [ 545.535811] env[64436]: INFO networking_nsxv3.common.synchronization [req-906f2e09-faa4-4e29-8479-bb80c0e94a5a req-4453af62-ef1a-4278-8a84-b9ed665dee79 service nova] Enqueued Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_members [ 545.535954] env[64436]: INFO networking_nsxv3.common.synchronization [req-906f2e09-faa4-4e29-8479-bb80c0e94a5a req-4453af62-ef1a-4278-8a84-b9ed665dee79 service nova] Enqueued Resource ID: c66177eb-1686-40a1-a08f-0c744f1e6989 with Priority: HIGHEST for action port [ 545.536469] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_rules [ 545.536721] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_members [ 545.536721] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c66177eb-1686-40a1-a08f-0c744f1e6989 with Priority: HIGHEST for action port [ 545.536965] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.537205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.537335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.537984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.538125] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.538969] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.539147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.539256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.539710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.539910] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.540227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.540349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.540557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.540694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.541109] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.542396] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c66177eb-1686-40a1-a08f-0c744f1e6989 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.542832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.542969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.543263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.543416] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c66177eb-1686-40a1-a08f-0c744f1e6989',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.663870] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.664057] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.664576] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.666220] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.666692] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.667579] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.667829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.668220] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.668484] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.668820] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 545.669035] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 545.669298] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 545.669646] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 545.669646] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 545.670179] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 545.671047] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 545.690271] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 545.690430] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 545.690575] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 545.690818] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.691092] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-cbfe3f79-2bd2-482c-9b31-04374399cc55 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.691290] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.691463] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.691703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.691839] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbfe3f79-2bd2-482c-9b31-04374399cc55',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.867264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.867264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.867264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.867264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.867264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.867264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.867264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 545.867264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.867264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 545.867801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.868039] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 already deleted. [ 545.868587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 545.998895] env[64436]: INFO networking_nsxv3.common.synchronization [None req-cdff2346-8294-4056-8ed6-dd406bbdb125 None None] Enqueued Resource ID: 619b9107-694c-462c-a162-1938979e811b with Priority: HIGHEST for action port [ 545.999588] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619b9107-694c-462c-a162-1938979e811b with Priority: HIGHEST for action port [ 546.000521] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-619b9107-694c-462c-a162-1938979e811b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.001081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-619b9107-694c-462c-a162-1938979e811b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.001220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-619b9107-694c-462c-a162-1938979e811b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.001651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-619b9107-694c-462c-a162-1938979e811b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.001651] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619b9107-694c-462c-a162-1938979e811b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.008687] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: SUCCESS [ 546.008687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.010531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.010531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.010711] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.011048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.011048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.011256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.013633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.013633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.013633] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.037706] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: SUCCESS [ 546.037706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.045404] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.046099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.046099] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.047083] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c66177eb-1686-40a1-a08f-0c744f1e6989 with status ACTIVE [ 546.047083] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.047083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.047083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.047308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.047733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.047733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.047733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.047733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.048356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.048356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.049394] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.049482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.049534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.049819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.049819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.049908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c66177eb-1686-40a1-a08f-0c744f1e6989 is going to be updated. [ 546.071354] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.072644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.072644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.072644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.072644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.072644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c66177eb-1686-40a1-a08f-0c744f1e6989" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.194850] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.195177] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.195707] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.196299] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.196980] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.197200] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port cbfe3f79-2bd2-482c-9b31-04374399cc55 not found, creating... [ 546.197623] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.197845] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.198044] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.199493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.199722] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.200792] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.200792] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.200792] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.202788] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.202788] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.202788] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: cbfe3f79-2bd2-482c-9b31-04374399cc55 is going to be created. [ 546.229219] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.229219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.229219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.229219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.229219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.229219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.507454] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 619b9107-694c-462c-a162-1938979e811b [ 546.507454] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.507911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.507911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.507911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.508031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.508063] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:619b9107-694c-462c-a162-1938979e811b already deleted. [ 546.508226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-619b9107-694c-462c-a162-1938979e811b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.515560] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.515995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.516084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.516329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.516535] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.516670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.516670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.516817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.516908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.517029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.517229] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.517316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.517316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.517564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.517605] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.517659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.517838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.517905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.517958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.518014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 546.518093] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.554543] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.729858] env[64436]: INFO networking_nsxv3.common.synchronization [None req-9c01072a-96fb-400b-897f-8b38363d43dd None None] Enqueued Resource ID: ed7c3c25-fe02-469e-b136-84a802b1d51d with Priority: HIGHEST for action port [ 546.729858] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7c3c25-fe02-469e-b136-84a802b1d51d with Priority: HIGHEST for action port [ 546.729858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed7c3c25-fe02-469e-b136-84a802b1d51d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.730659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed7c3c25-fe02-469e-b136-84a802b1d51d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 546.731099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed7c3c25-fe02-469e-b136-84a802b1d51d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.732824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed7c3c25-fe02-469e-b136-84a802b1d51d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 546.732824] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7c3c25-fe02-469e-b136-84a802b1d51d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.021345] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a495b570-59ee-467c-baf8-b41b06814023: rpc.has_security_group_logging(os_id): False [ 547.041163] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.041318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.042067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.042067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.042067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.042067] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.042067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.042067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.042422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.042422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.042515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.042579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.042626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.046542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.046542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.046542] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.046542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.046542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.046542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.046542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.046542] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be created. [ 547.050460] env[64436]: INFO networking_nsxv3.common.synchronization [req-0bdf9955-223d-4cc4-be05-df1741ceb332 req-85b26fc4-456d-417f-b606-5d5b41506098 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_members [ 547.050460] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_members [ 547.050564] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.050847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.050847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.051598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.051598] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.051598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.051598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.051598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.051598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.051598] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.055713] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.055826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.056034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.056317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.056477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.056610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a is going to be created. [ 547.083758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.083758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.084278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.084278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.084278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.096365] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a in Status: UNINITIALIZED for 2s [ 547.120021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.120021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.120021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.120021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.120021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.132829] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: IN_PROGRESS for 2s [ 547.169650] env[64436]: INFO networking_nsxv3.common.synchronization [None req-184933e8-0a25-41d8-a740-73bb5afce4da None None] Enqueued Resource ID: 1b285ae8-1457-476c-9ae3-4459f817a3ff with Priority: HIGHEST for action port [ 547.169650] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b285ae8-1457-476c-9ae3-4459f817a3ff with Priority: HIGHEST for action port [ 547.170880] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b285ae8-1457-476c-9ae3-4459f817a3ff taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.171039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b285ae8-1457-476c-9ae3-4459f817a3ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.171039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b285ae8-1457-476c-9ae3-4459f817a3ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.171290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b285ae8-1457-476c-9ae3-4459f817a3ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.171388] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b285ae8-1457-476c-9ae3-4459f817a3ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.184755] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.186343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.186343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.186343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.186343] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.186343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.186343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.186343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.186343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.187143] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 547.188232] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 547.188232] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 547.188232] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 547.188232] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 547.188232] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 547.188232] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 547.235610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed7c3c25-fe02-469e-b136-84a802b1d51d [ 547.235610] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.235610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.235610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.235610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.235610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.235610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed7c3c25-fe02-469e-b136-84a802b1d51d already deleted. [ 547.235610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed7c3c25-fe02-469e-b136-84a802b1d51d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.243400] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 547.243400] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 547.243400] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 547.243400] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.243400] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.243674] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.243674] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.244370] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.244455] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.554143] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.554405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.554405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.554773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.554912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.555725] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.555725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.555725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.555725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.555725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.555725] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab78b72f-7655-492a-8135-613a26cfa217 already deleted. [ 547.556011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.620731] env[64436]: INFO networking_nsxv3.common.synchronization [None req-669ce591-be05-4ec1-b664-42e33f51ef11 None None] Enqueued Resource ID: 49165567-0ef2-4020-bfad-588ea7ba9d57 with Priority: HIGHEST for action port [ 547.623056] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49165567-0ef2-4020-bfad-588ea7ba9d57 with Priority: HIGHEST for action port [ 547.623613] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-49165567-0ef2-4020-bfad-588ea7ba9d57 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.623867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49165567-0ef2-4020-bfad-588ea7ba9d57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.624235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49165567-0ef2-4020-bfad-588ea7ba9d57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.624489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49165567-0ef2-4020-bfad-588ea7ba9d57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.624729] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49165567-0ef2-4020-bfad-588ea7ba9d57',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.678939] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b285ae8-1457-476c-9ae3-4459f817a3ff [ 547.679200] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.680583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.680583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.680583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.680583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.680583] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b285ae8-1457-476c-9ae3-4459f817a3ff already deleted. [ 547.680583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b285ae8-1457-476c-9ae3-4459f817a3ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.747437] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.747730] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.748059] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.748424] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.748562] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.748894] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 not found, creating... [ 547.749240] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.749488] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.750173] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.750484] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.750697] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.750893] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.751080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.751202] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.751425] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.751627] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.751703] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 is going to be created. [ 547.770051] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.770279] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.770408] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.770680] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.770913] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 547.771147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.117334] env[64436]: INFO networking_nsxv3.common.synchronization [req-b3bf208d-9437-4d64-812a-4a98c3f54d2f req-bc8ce1d7-55fe-4816-b2a1-b02300d9a763 service nova] Enqueued Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_rules [ 548.117334] env[64436]: INFO networking_nsxv3.common.synchronization [req-b3bf208d-9437-4d64-812a-4a98c3f54d2f req-bc8ce1d7-55fe-4816-b2a1-b02300d9a763 service nova] Enqueued Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_members [ 548.117334] env[64436]: INFO networking_nsxv3.common.synchronization [req-b3bf208d-9437-4d64-812a-4a98c3f54d2f req-bc8ce1d7-55fe-4816-b2a1-b02300d9a763 service nova] Enqueued Resource ID: cbfe3f79-2bd2-482c-9b31-04374399cc55 with Priority: HIGHEST for action port [ 548.117334] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_rules [ 548.117334] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_members [ 548.117334] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfe3f79-2bd2-482c-9b31-04374399cc55 with Priority: HIGHEST for action port [ 548.120717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1017fee-6833-4760-849a-3861937d36d9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.120717] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.120717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1017fee-6833-4760-849a-3861937d36d9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.120717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.120717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.120717] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.121700] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbfe3f79-2bd2-482c-9b31-04374399cc55 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.121970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.122197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.122432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.122674] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbfe3f79-2bd2-482c-9b31-04374399cc55',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.128996] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49165567-0ef2-4020-bfad-588ea7ba9d57 [ 548.130296] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.131535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.131535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.131535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.131535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.131535] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49165567-0ef2-4020-bfad-588ea7ba9d57 already deleted. [ 548.131535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49165567-0ef2-4020-bfad-588ea7ba9d57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.223589] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b087418b-e96d-434e-87dc-517b3a426153 tempest-ServersWithSpecificFlavorTestJSON-1646558451 tempest-ServersWithSpecificFlavorTestJSON-1646558451-project-member] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 548.223799] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 548.224316] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.224520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.224520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.224772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.224810] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.426850] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.427055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.427214] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.427786] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.427887] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.430098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.430272] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.431041] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.431041] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.431175] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 548.432114] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 548.432417] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 548.432498] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 548.432797] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 548.432797] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 548.433031] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 548.456566] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 548.456566] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 548.456566] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 548.456566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.456566] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.456566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.456566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.456566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.457616] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('982c1fcb-e6dd-4d49-8eae-3aaf3849380b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.496160] env[64436]: INFO networking_nsxv3.common.synchronization [None req-4ebaf9ba-604c-4910-bc81-fb27b6bd99d7 tempest-ServersWithSpecificFlavorTestJSON-1646558451 tempest-ServersWithSpecificFlavorTestJSON-1646558451-project-member] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 548.496465] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 548.496794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.497694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.626478] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.628346] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1017fee-6833-4760-849a-3861937d36d9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.628346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.628346] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbfe3f79-2bd2-482c-9b31-04374399cc55 with status ACTIVE [ 548.628346] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.628346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.628346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.628792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.628792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.628792] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.628792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.628919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.628972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.629058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.629232] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.629321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.629379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.629513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.631778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.631976] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbfe3f79-2bd2-482c-9b31-04374399cc55 is going to be updated. [ 548.653734] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.653872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.653940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.654182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.654328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.654492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbfe3f79-2bd2-482c-9b31-04374399cc55" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.760206] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.760206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.760206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.760206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.760206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.760206] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc already deleted. [ 548.760206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.760206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.760206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.761849] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.962315] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.962532] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.962681] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.963049] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.963049] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.963414] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 982c1fcb-e6dd-4d49-8eae-3aaf3849380b not found, creating... [ 548.963474] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.963634] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.963728] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.963950] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.964102] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.964382] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.964541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.964661] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.964861] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.965008] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.965347] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 982c1fcb-e6dd-4d49-8eae-3aaf3849380b is going to be created. [ 548.970150] env[64436]: INFO networking_nsxv3.common.synchronization [req-71f6e7c8-f978-445c-b634-7c91a7d855ee req-b0936a5c-9c53-4a6c-a512-3bce033e6327 service nova] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_rules [ 548.970341] env[64436]: INFO networking_nsxv3.common.synchronization [req-71f6e7c8-f978-445c-b634-7c91a7d855ee req-b0936a5c-9c53-4a6c-a512-3bce033e6327 service nova] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 548.972208] env[64436]: INFO networking_nsxv3.common.synchronization [req-71f6e7c8-f978-445c-b634-7c91a7d855ee req-b0936a5c-9c53-4a6c-a512-3bce033e6327 service nova] Enqueued Resource ID: 00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 with Priority: HIGHEST for action port [ 548.972208] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_rules [ 548.972208] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 548.972208] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 with Priority: HIGHEST for action port [ 548.972208] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.972208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.972208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.972208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.972208] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.972983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.972983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.972983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.973202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.973318] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.973443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.973528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.973697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.973811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.973922] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.974645] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.974796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.975366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.975648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.976249] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.985108] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.985108] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.985108] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.985108] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.985108] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.985445] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.106349] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a in Status: SUCCESS [ 549.106349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.106860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.110716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.110716] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.110716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.110716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.110716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.111033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.111033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.111033] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.134831] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.147075] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: SUCCESS [ 549.147300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.284419] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.284573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.284644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.284856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.284949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.285113] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc already deleted. [ 549.285222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.361252] env[64436]: INFO networking_nsxv3.common.synchronization [None req-2ef3b222-65ad-4d32-aa97-8bb853eea436 None None] Enqueued Resource ID: 49329f65-c133-42d0-af5b-10a0827b718b with Priority: HIGHEST for action port [ 549.361507] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49329f65-c133-42d0-af5b-10a0827b718b with Priority: HIGHEST for action port [ 549.362826] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-49329f65-c133-42d0-af5b-10a0827b718b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.362826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49329f65-c133-42d0-af5b-10a0827b718b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.362826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49329f65-c133-42d0-af5b-10a0827b718b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.362826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49329f65-c133-42d0-af5b-10a0827b718b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.362826] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49329f65-c133-42d0-af5b-10a0827b718b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.478313] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.481475] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.481608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.481988] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 with status ACTIVE [ 549.485247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.485247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.485247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.485247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.485247] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1 is going to be updated. [ 549.504766] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.504766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.504766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.504766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.504766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.504766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00d0cc8f-55e9-4b4a-9fd2-233c5ec8aab1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.614478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.615180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.615267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.615858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.615858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.616049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.616049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.616182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.616269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.616420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.616767] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.616875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.616966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.617213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.617425] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.618313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.618313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.618313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.618313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.618313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.618509] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.637487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.637487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.637487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.637901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.637901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.637901] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1017fee-6833-4760-849a-3861937d36d9 is going to be created. [ 549.666694] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.666913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.667157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.667382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.667943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.678501] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1017fee-6833-4760-849a-3861937d36d9 in Status: UNINITIALIZED for 2s [ 549.866752] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49329f65-c133-42d0-af5b-10a0827b718b [ 549.866752] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.866752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.866752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.866752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.866752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.866752] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49329f65-c133-42d0-af5b-10a0827b718b already deleted. [ 549.866752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49329f65-c133-42d0-af5b-10a0827b718b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.982317] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.123571] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ef0380e-f32f-4c88-984c-a677acaaff0a: rpc.has_security_group_logging(os_id): False [ 550.143031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.143031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.143031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.143031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.143835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.143835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.143835] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.143835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.143835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.143835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.143835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.143835] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a is going to be created. [ 550.230567] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.230706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.230774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.232539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.232746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.246115] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a in Status: IN_PROGRESS for 2s [ 550.487876] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.487876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.487876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.487876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.487876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.487876] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be created. [ 550.509433] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.511499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.511499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.511499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.511499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.522179] env[64436]: INFO networking_nsxv3.common.synchronization [req-0bdf9955-223d-4cc4-be05-df1741ceb332 req-64fd849c-53ba-4f6e-a816-5bd47a6360f7 service nova] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_rules [ 550.522360] env[64436]: INFO networking_nsxv3.common.synchronization [req-0bdf9955-223d-4cc4-be05-df1741ceb332 req-64fd849c-53ba-4f6e-a816-5bd47a6360f7 service nova] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_members [ 550.522526] env[64436]: INFO networking_nsxv3.common.synchronization [req-0bdf9955-223d-4cc4-be05-df1741ceb332 req-64fd849c-53ba-4f6e-a816-5bd47a6360f7 service nova] Enqueued Resource ID: 982c1fcb-e6dd-4d49-8eae-3aaf3849380b with Priority: HIGHEST for action port [ 550.523909] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: UNINITIALIZED for 2s [ 550.524037] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_rules [ 550.524155] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_members [ 550.524280] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 982c1fcb-e6dd-4d49-8eae-3aaf3849380b with Priority: HIGHEST for action port [ 550.525196] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.525196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.525196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.525196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.525196] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.526691] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.527972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.528073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.528307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.528474] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.528581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.528656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.528816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.528896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 550.529021] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.529831] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.529941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 550.530142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.530221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 550.530257] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('982c1fcb-e6dd-4d49-8eae-3aaf3849380b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.031966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.032284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.032336] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.033959] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 982c1fcb-e6dd-4d49-8eae-3aaf3849380b with status ACTIVE [ 551.034178] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.034590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.034675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.034966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.035079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.035262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.035373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.035432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.035594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.035667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.035841] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.035932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.036110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.036234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.036348] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.036473] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 982c1fcb-e6dd-4d49-8eae-3aaf3849380b is going to be updated. [ 551.058412] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.058578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.058654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.058871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.059033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.059205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-982c1fcb-e6dd-4d49-8eae-3aaf3849380b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.191668] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f9e8b6a1-4312-45d4-8588-0ef0c7bbf689 None None] Enqueued Resource ID: a0c2a227-21a5-4db0-82c1-3fa681b39f81 with Priority: HIGHEST for action port [ 551.191971] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c2a227-21a5-4db0-82c1-3fa681b39f81 with Priority: HIGHEST for action port [ 551.192744] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0c2a227-21a5-4db0-82c1-3fa681b39f81 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.193506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0c2a227-21a5-4db0-82c1-3fa681b39f81" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.193575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0c2a227-21a5-4db0-82c1-3fa681b39f81" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.193852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0c2a227-21a5-4db0-82c1-3fa681b39f81" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.193935] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0c2a227-21a5-4db0-82c1-3fa681b39f81',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.534524] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.691139] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1017fee-6833-4760-849a-3861937d36d9 in Status: SUCCESS [ 551.691447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.691521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.691708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.691854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.692025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.692082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.692179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.692375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.692375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.692474] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.696138] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0c2a227-21a5-4db0-82c1-3fa681b39f81 [ 551.696342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.696485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.696516] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.696722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.696771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.696833] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0c2a227-21a5-4db0-82c1-3fa681b39f81 already deleted. [ 551.696910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0c2a227-21a5-4db0-82c1-3fa681b39f81" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.697704] env[64436]: INFO networking_nsxv3.common.synchronization [None req-31ffdea8-9151-452c-a62c-a6c12a34a00f None None] Enqueued Resource ID: eb6b19e2-460e-4aac-b06b-8297abf5e5fe with Priority: HIGHEST for action port [ 551.698215] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb6b19e2-460e-4aac-b06b-8297abf5e5fe with Priority: HIGHEST for action port [ 551.698982] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb6b19e2-460e-4aac-b06b-8297abf5e5fe taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.698982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb6b19e2-460e-4aac-b06b-8297abf5e5fe" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.698982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb6b19e2-460e-4aac-b06b-8297abf5e5fe" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.699254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb6b19e2-460e-4aac-b06b-8297abf5e5fe" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.699254] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb6b19e2-460e-4aac-b06b-8297abf5e5fe',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.873550] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ae6388d5-000d-4b8b-991b-6b7ece07efd8 None None] Enqueued Resource ID: 476cd2b8-ca03-44d7-8cb2-446f581adf5e with Priority: HIGHEST for action port [ 551.873550] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 476cd2b8-ca03-44d7-8cb2-446f581adf5e with Priority: HIGHEST for action port [ 551.873550] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-476cd2b8-ca03-44d7-8cb2-446f581adf5e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.873550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-476cd2b8-ca03-44d7-8cb2-446f581adf5e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.873550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-476cd2b8-ca03-44d7-8cb2-446f581adf5e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.874110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-476cd2b8-ca03-44d7-8cb2-446f581adf5e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.874207] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476cd2b8-ca03-44d7-8cb2-446f581adf5e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.039097] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.039438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.039438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.039574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.039652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.039752] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab78b72f-7655-492a-8135-613a26cfa217 is going to be created. [ 552.066307] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.066475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.066714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.066773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.066923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.078962] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: UNINITIALIZED for 2s [ 552.195717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1017fee-6833-4760-849a-3861937d36d9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.195717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.195833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.196084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.196313] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.196436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.196509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.196677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.196760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.196861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.197065] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1017fee-6833-4760-849a-3861937d36d9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.197150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.197197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.197343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.197603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.197700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.197773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.198322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.198322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.198322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.198322] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.202513] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb6b19e2-460e-4aac-b06b-8297abf5e5fe [ 552.202716] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.202843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.202910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.203049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.203139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.203210] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb6b19e2-460e-4aac-b06b-8297abf5e5fe already deleted. [ 552.203339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb6b19e2-460e-4aac-b06b-8297abf5e5fe" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.259846] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a in Status: SUCCESS [ 552.259846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.377832] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 476cd2b8-ca03-44d7-8cb2-446f581adf5e [ 552.378141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.378282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.378353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.378607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.378672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.378807] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:476cd2b8-ca03-44d7-8cb2-446f581adf5e already deleted. [ 552.378896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-476cd2b8-ca03-44d7-8cb2-446f581adf5e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.534904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: SUCCESS [ 552.534904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.534904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.534904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.534904] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.534904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.534904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.534904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.534904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.535381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.535381] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.702065] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1017fee-6833-4760-849a-3861937d36d9: rpc.has_security_group_logging(os_id): False [ 552.721175] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.722586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.722586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.722586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.723016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.723016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.723016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.723016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.723341] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.723341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.723341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.723677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.723677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.723677] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1017fee-6833-4760-849a-3861937d36d9 is going to be created. [ 552.778896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.779056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 552.779141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.779359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 552.780212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 552.790158] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1017fee-6833-4760-849a-3861937d36d9 in Status: IN_PROGRESS for 2s [ 553.037730] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.037896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.037970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.038768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.038768] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.038768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.038768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.038768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.038768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.039346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.039346] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.039346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.039346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.039346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.040551] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.040551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.040551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.040551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.040551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.040551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.040551] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.543211] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39b1f9d7-0460-4fa5-8bf2-270d994f79e5: rpc.has_security_group_logging(os_id): False [ 553.566537] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.566818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.566818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.567135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.567342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.567566] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.567783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.567783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.567968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.570244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.572034] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.572034] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.572034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.572034] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be created. [ 553.631761] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.631918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.632994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.633601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.633849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.643676] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: IN_PROGRESS for 2s [ 554.088440] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: SUCCESS [ 554.090030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.090030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.090373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.090647] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.090881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.091037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.092370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.092370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.092370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.092370] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.149441] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b65290ba-f77e-4a67-8be1-3055d7441ad6 None None] Enqueued Resource ID: 52ac0b33-dcd2-4f40-9667-7d763520cbf1 with Priority: HIGHEST for action port [ 554.153036] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52ac0b33-dcd2-4f40-9667-7d763520cbf1 with Priority: HIGHEST for action port [ 554.153036] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-52ac0b33-dcd2-4f40-9667-7d763520cbf1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.153036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52ac0b33-dcd2-4f40-9667-7d763520cbf1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.153036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52ac0b33-dcd2-4f40-9667-7d763520cbf1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.153036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52ac0b33-dcd2-4f40-9667-7d763520cbf1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.153036] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52ac0b33-dcd2-4f40-9667-7d763520cbf1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.595853] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.657587] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52ac0b33-dcd2-4f40-9667-7d763520cbf1 [ 554.657587] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.657587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.657587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.657587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.657587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.659739] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52ac0b33-dcd2-4f40-9667-7d763520cbf1 already deleted. [ 554.659739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52ac0b33-dcd2-4f40-9667-7d763520cbf1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.802015] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1017fee-6833-4760-849a-3861937d36d9 in Status: SUCCESS [ 554.802267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.959019] env[64436]: INFO networking_nsxv3.common.synchronization [req-b212a8b2-b4e7-4783-abc4-21fcd5a8afa0 req-d2de1a3f-e4c1-4896-88ae-52d0fa92422c tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 554.959019] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 554.959019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.959019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.959019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.959019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.959019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.961263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.961467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.961631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.961769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.961914] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.099339] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab78b72f-7655-492a-8135-613a26cfa217: rpc.has_security_group_logging(os_id): False [ 555.117220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.117489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.117489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.117686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.118293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.118416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.118879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.118879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.118879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.118879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.118879] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab78b72f-7655-492a-8135-613a26cfa217 is going to be created. [ 555.178497] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.178769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.178769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.179014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.179156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.190136] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: IN_PROGRESS for 2s [ 555.214273] env[64436]: INFO networking_nsxv3.common.synchronization [None req-434fec94-90bb-4af2-b9fd-55538da1288c None None] Enqueued Resource ID: 01796996-daff-4ba4-b047-7aac8790b357 with Priority: HIGHEST for action port [ 555.214273] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01796996-daff-4ba4-b047-7aac8790b357 with Priority: HIGHEST for action port [ 555.214273] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-01796996-daff-4ba4-b047-7aac8790b357 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.214446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01796996-daff-4ba4-b047-7aac8790b357" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.214906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01796996-daff-4ba4-b047-7aac8790b357" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.215199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01796996-daff-4ba4-b047-7aac8790b357" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.215290] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01796996-daff-4ba4-b047-7aac8790b357',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.467366] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.467979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.467979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.467979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.467979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.468292] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.468472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.468538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.468704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.468797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.468884] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 already deleted. [ 555.468964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.639268] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.644699] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.644699] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.644699] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.644699] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.644699] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.646553] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.646553] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.646553] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.646553] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 555.646553] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 555.646553] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 555.646553] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 555.646553] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 555.646855] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 555.646855] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 555.663399] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: SUCCESS [ 555.663399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.669386] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 555.669386] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 555.669386] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 555.669988] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.670379] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-51fdb18c-9141-4242-82c8-bf5ac1be7348 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.670580] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.670706] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.671098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.671257] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51fdb18c-9141-4242-82c8-bf5ac1be7348',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.717882] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01796996-daff-4ba4-b047-7aac8790b357 [ 555.717882] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.718040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.718080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.718268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.718359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.718468] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01796996-daff-4ba4-b047-7aac8790b357 already deleted. [ 555.718548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01796996-daff-4ba4-b047-7aac8790b357" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.177550] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.177963] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.177963] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.178282] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.178444] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.178656] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 51fdb18c-9141-4242-82c8-bf5ac1be7348 not found, creating... [ 556.178959] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.179137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.179315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.179510] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.179994] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.180487] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.180687] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.180825] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.181081] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.181257] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.181407] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 51fdb18c-9141-4242-82c8-bf5ac1be7348 is going to be created. [ 556.203229] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.203581] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.203717] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.204063] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.204330] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.204583] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.680997] env[64436]: INFO networking_nsxv3.common.synchronization [None req-3ca3658b-2828-4245-91d1-64d17c8f5f0e None None] Enqueued Resource ID: 6cf38c3b-5750-4c31-8132-6f6eeb5c358c with Priority: HIGHEST for action port [ 556.680997] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf38c3b-5750-4c31-8132-6f6eeb5c358c with Priority: HIGHEST for action port [ 556.680997] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cf38c3b-5750-4c31-8132-6f6eeb5c358c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.680997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cf38c3b-5750-4c31-8132-6f6eeb5c358c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.680997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cf38c3b-5750-4c31-8132-6f6eeb5c358c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.682311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cf38c3b-5750-4c31-8132-6f6eeb5c358c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.682508] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cf38c3b-5750-4c31-8132-6f6eeb5c358c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.835222] env[64436]: INFO networking_nsxv3.common.synchronization [None req-09302468-e180-4e93-b082-7c4e77d6a509 None None] Enqueued Resource ID: 46a70e07-0218-4250-98a0-f868d59ebef1 with Priority: HIGHEST for action port [ 556.835506] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a70e07-0218-4250-98a0-f868d59ebef1 with Priority: HIGHEST for action port [ 556.836058] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a70e07-0218-4250-98a0-f868d59ebef1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.836186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a70e07-0218-4250-98a0-f868d59ebef1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.836248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a70e07-0218-4250-98a0-f868d59ebef1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.836520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a70e07-0218-4250-98a0-f868d59ebef1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.836601] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a70e07-0218-4250-98a0-f868d59ebef1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.031861] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d2566a1e-66af-4f7b-ad04-8240e8dde773 None None] Enqueued Resource ID: eb8cbf0a-e189-45bf-846d-49a3d86b526a with Priority: HIGHEST for action port [ 557.031861] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb8cbf0a-e189-45bf-846d-49a3d86b526a with Priority: HIGHEST for action port [ 557.032241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb8cbf0a-e189-45bf-846d-49a3d86b526a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.032241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb8cbf0a-e189-45bf-846d-49a3d86b526a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 557.033185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb8cbf0a-e189-45bf-846d-49a3d86b526a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.033497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb8cbf0a-e189-45bf-846d-49a3d86b526a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 557.033587] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb8cbf0a-e189-45bf-846d-49a3d86b526a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.185449] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cf38c3b-5750-4c31-8132-6f6eeb5c358c [ 557.186034] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.186034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 557.186034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.186325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 557.186325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.186401] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cf38c3b-5750-4c31-8132-6f6eeb5c358c already deleted. [ 557.186879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cf38c3b-5750-4c31-8132-6f6eeb5c358c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.202545] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: SUCCESS [ 557.202840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.340407] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46a70e07-0218-4250-98a0-f868d59ebef1 [ 557.341386] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.341386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 557.341386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.341386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 557.341386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.341713] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46a70e07-0218-4250-98a0-f868d59ebef1 already deleted. [ 557.341782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a70e07-0218-4250-98a0-f868d59ebef1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.536380] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb8cbf0a-e189-45bf-846d-49a3d86b526a [ 557.536563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.536651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 557.536701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.536920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 557.537020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.537118] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb8cbf0a-e189-45bf-846d-49a3d86b526a already deleted. [ 557.537203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb8cbf0a-e189-45bf-846d-49a3d86b526a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.048877] env[64436]: INFO networking_nsxv3.common.synchronization [None req-1421f29d-9c11-4e1c-ac0b-a879fe69bc3e None None] Enqueued Resource ID: bc710057-d146-4b12-87cf-7cdf23725fa8 with Priority: HIGHEST for action port [ 558.049402] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc710057-d146-4b12-87cf-7cdf23725fa8 with Priority: HIGHEST for action port [ 558.049703] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc710057-d146-4b12-87cf-7cdf23725fa8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.049816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc710057-d146-4b12-87cf-7cdf23725fa8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.049881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc710057-d146-4b12-87cf-7cdf23725fa8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.053465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc710057-d146-4b12-87cf-7cdf23725fa8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.053753] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc710057-d146-4b12-87cf-7cdf23725fa8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.064532] env[64436]: INFO networking_nsxv3.common.synchronization [None req-6a53fc48-9163-4699-a2d7-e0cf05ab72ae tempest-ServerActionsV293TestJSON-1533962128 tempest-ServerActionsV293TestJSON-1533962128-project-member] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_rules [ 558.066170] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_rules [ 558.066170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.066170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.066170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.068217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.068217] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.370248] env[64436]: INFO networking_nsxv3.common.synchronization [None req-e5ba272d-59f2-44b8-97e8-6c50ad59fa63 tempest-ServerActionsV293TestJSON-1533962128 tempest-ServerActionsV293TestJSON-1533962128-project-member] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_rules [ 558.370819] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_rules [ 558.372857] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.373014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.557373] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc710057-d146-4b12-87cf-7cdf23725fa8 [ 558.557594] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.557727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.557798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.558105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.558177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.558310] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc710057-d146-4b12-87cf-7cdf23725fa8 already deleted. [ 558.558372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc710057-d146-4b12-87cf-7cdf23725fa8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.586656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.586820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.587028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.587107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.587204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.587277] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba already deleted. [ 558.587356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.587510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.589143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.589301] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.637430] env[64436]: INFO networking_nsxv3.common.synchronization [req-b212a8b2-b4e7-4783-abc4-21fcd5a8afa0 req-f5eed87f-e3e3-464a-8590-4d466b0b1991 service nova] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_rules [ 558.637430] env[64436]: INFO networking_nsxv3.common.synchronization [req-b212a8b2-b4e7-4783-abc4-21fcd5a8afa0 req-f5eed87f-e3e3-464a-8590-4d466b0b1991 service nova] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 558.637506] env[64436]: INFO networking_nsxv3.common.synchronization [req-b212a8b2-b4e7-4783-abc4-21fcd5a8afa0 req-f5eed87f-e3e3-464a-8590-4d466b0b1991 service nova] Enqueued Resource ID: 51fdb18c-9141-4242-82c8-bf5ac1be7348 with Priority: HIGHEST for action port [ 558.638862] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_rules [ 558.639047] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 558.639165] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51fdb18c-9141-4242-82c8-bf5ac1be7348 with Priority: HIGHEST for action port [ 558.641031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.641031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.641031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.641031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.641303] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.642837] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.643665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.643665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.643665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.643963] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.643963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.644074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.644216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.644443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.644557] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.646038] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-51fdb18c-9141-4242-82c8-bf5ac1be7348 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.646185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.646185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.646420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.646420] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51fdb18c-9141-4242-82c8-bf5ac1be7348',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.087876] env[64436]: INFO networking_nsxv3.common.synchronization [req-8f4f7d73-caea-4235-96ca-95ba541a0522 req-25745e17-c623-4ae9-b53d-279617e4c1a4 tempest-VolumesAssistedSnapshotsTest-817485114 tempest-VolumesAssistedSnapshotsTest-817485114-project-member] Enqueued Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_members [ 559.090430] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_members [ 559.091299] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc5500f-a0f5-4e87-aa9b-0020789243e9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.091407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.091546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.091856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.092087] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.092231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.092306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.093074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.093074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.093074] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.115463] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.115734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.115908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.116192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.116360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.118116] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba already deleted. [ 559.118116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.149250] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51fdb18c-9141-4242-82c8-bf5ac1be7348 with status ACTIVE [ 559.149905] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.151017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.151017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.151017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.151148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.151306] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.151469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.151554] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.151769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.151905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.152147] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.152340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.152389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.154154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.155328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.155328] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51fdb18c-9141-4242-82c8-bf5ac1be7348 is going to be updated. [ 559.156724] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.156842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.157075] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.187246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.189035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.189035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.189035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.189035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.189035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51fdb18c-9141-4242-82c8-bf5ac1be7348" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.599607] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.600061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.600061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.600637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.600887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.601522] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.601779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.601847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.602044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.602144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.602762] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 already deleted. [ 559.602870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.665921] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.167539] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.167707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 560.167781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.168025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 560.168079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 560.168177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be created. [ 560.191827] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.191977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 560.192166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.194026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 560.194026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 560.201737] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: UNINITIALIZED for 2s [ 560.352913] env[64436]: INFO networking_nsxv3.common.synchronization [None req-2982257a-e299-4df0-93e1-fc39ad8d18f1 None None] Enqueued Resource ID: 2552589a-bc26-4ab5-aef0-4fa6b42768e0 with Priority: HIGHEST for action port [ 560.353193] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2552589a-bc26-4ab5-aef0-4fa6b42768e0 with Priority: HIGHEST for action port [ 560.357029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2552589a-bc26-4ab5-aef0-4fa6b42768e0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.357326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2552589a-bc26-4ab5-aef0-4fa6b42768e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 560.357445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2552589a-bc26-4ab5-aef0-4fa6b42768e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.357892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2552589a-bc26-4ab5-aef0-4fa6b42768e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 560.358246] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2552589a-bc26-4ab5-aef0-4fa6b42768e0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.862253] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2552589a-bc26-4ab5-aef0-4fa6b42768e0 [ 560.862253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.862253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 560.862253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.862253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 560.862253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 560.862253] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2552589a-bc26-4ab5-aef0-4fa6b42768e0 already deleted. [ 560.862253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2552589a-bc26-4ab5-aef0-4fa6b42768e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.549732] env[64436]: INFO networking_nsxv3.common.synchronization [req-07293a79-602d-46c1-ade1-a4c4be33a421 req-3924180b-821b-4ecf-8fbf-cac045178985 tempest-DeleteServersAdminTestJSON-141036157 tempest-DeleteServersAdminTestJSON-141036157-project-admin] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 561.549732] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 561.549732] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.549732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.549732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.549732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.553106] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.553106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.555521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.555521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.555521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.555521] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.865211] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.865597] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-516" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.865771] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-516" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.866200] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-516" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.866588] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.866933] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.867192] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.867513] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.867739] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.868119] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 561.868357] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 561.868627] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 561.868855] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 561.869097] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 561.869461] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 561.869669] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 561.887141] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 561.887141] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 561.887141] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 561.887365] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-516" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.887577] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.887765] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.887900] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.888316] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.888469] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.057600] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.057600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.057600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.057600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.057600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.063024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.063024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.063024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.063024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.063024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.063024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be updated. [ 562.090653] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.090653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.090653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.091628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.091628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.102742] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: IN_PROGRESS for 2s [ 562.211943] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 562.212239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.212409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.212636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.212827] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.212938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.213016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.213172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.213253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.213338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.213427] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.394660] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.394829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.394961] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.395499] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.395499] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.395608] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 not found, creating... [ 562.395908] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.396148] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.396185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.399653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.399814] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.400506] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.400684] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.400802] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.401057] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.402053] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.402053] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 is going to be created. [ 562.419293] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.419764] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.419764] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.420073] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.420414] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.421347] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.717394] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.717394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.717394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.717394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.717561] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.717677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.717722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.717870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.718607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.718607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.718607] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.718607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.718607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.718607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.718946] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.718946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.718946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.718946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.719084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.719120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.719180] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.870901] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f04bb3f6-4d05-448e-aff6-8470d228b5e1 None None] Enqueued Resource ID: 7034ff53-01b0-42b5-a36c-36d3ff70a68c with Priority: HIGHEST for action port [ 562.871159] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7034ff53-01b0-42b5-a36c-36d3ff70a68c with Priority: HIGHEST for action port [ 562.871671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-7034ff53-01b0-42b5-a36c-36d3ff70a68c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.871789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7034ff53-01b0-42b5-a36c-36d3ff70a68c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.871857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7034ff53-01b0-42b5-a36c-36d3ff70a68c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.872198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7034ff53-01b0-42b5-a36c-36d3ff70a68c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.872321] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7034ff53-01b0-42b5-a36c-36d3ff70a68c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.057050] env[64436]: INFO networking_nsxv3.common.synchronization [None req-59043e2c-502a-46f8-916c-f7d21205f8b1 None None] Enqueued Resource ID: 1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c with Priority: HIGHEST for action port [ 563.057050] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c with Priority: HIGHEST for action port [ 563.057050] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.062192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.062192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.062192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.062192] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.224202] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a7c16cc-25b5-4f14-86e6-c0818627fd71: rpc.has_security_group_logging(os_id): False [ 563.246032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.246032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.246032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.246555] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.246555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.246555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.246555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.246555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.246709] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.246800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.246845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.247366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.247366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.247366] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be created. [ 563.264176] env[64436]: INFO networking_nsxv3.common.synchronization [req-233d9c84-dd81-494c-b13e-34c10b7dc8ed req-f14d3b38-a67e-494d-8701-9fd4599e2e3b tempest-ServersTestFqdnHostnames-248546948 tempest-ServersTestFqdnHostnames-248546948-project-member] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_members [ 563.264718] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_members [ 563.265046] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.265171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.265372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.265565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.265695] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.265799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.265850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.266018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.268874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.268874] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.308166] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.308870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.308870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.308870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.308870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.322433] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 563.375207] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7034ff53-01b0-42b5-a36c-36d3ff70a68c [ 563.375444] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.375624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.375722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.375947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.376049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.376144] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7034ff53-01b0-42b5-a36c-36d3ff70a68c already deleted. [ 563.376238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7034ff53-01b0-42b5-a36c-36d3ff70a68c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.566530] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c [ 563.567735] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.567998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.567998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.568963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.568963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.568963] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c already deleted. [ 563.568963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e0ac3d8-3422-4c0b-8c94-dbea4df0d09c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.772340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.772340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.772340] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b966170-3dea-4773-8900-e7034ff19049 already deleted. [ 563.772340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.931037] env[64436]: INFO networking_nsxv3.common.synchronization [None req-74d993d7-5be2-4798-8a25-5380fbc2c0fd tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 563.935075] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 563.935075] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.935075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.935075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.935075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.935075] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.115805] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: SUCCESS [ 564.115805] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 deletion is rescheduled due to dependency. [ 564.115805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.140283] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ecdb5980-70d2-40cb-9ae1-b39646d86b56 None None] Enqueued Resource ID: 67f587f7-4131-48e1-9f5a-029a3b5c8853 with Priority: HIGHEST for action port [ 564.141278] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f587f7-4131-48e1-9f5a-029a3b5c8853 with Priority: HIGHEST for action port [ 564.141620] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-67f587f7-4131-48e1-9f5a-029a3b5c8853 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.141806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67f587f7-4131-48e1-9f5a-029a3b5c8853" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.141870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67f587f7-4131-48e1-9f5a-029a3b5c8853" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.142148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67f587f7-4131-48e1-9f5a-029a3b5c8853" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.145601] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67f587f7-4131-48e1-9f5a-029a3b5c8853',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.448281] env[64436]: INFO networking_nsxv3.common.synchronization [None req-aa261c81-90bd-464d-949d-8491f82d483f tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 564.449120] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 564.449238] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.449348] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.458170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.458927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.459122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.459770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.459833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.459956] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d already deleted. [ 564.460076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.460286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.462938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.462938] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.590151] env[64436]: INFO networking_nsxv3.common.synchronization [None req-7b14314a-bb4d-4f77-836c-84ee662cd0bb None None] Enqueued Resource ID: a4f45f03-4a5f-4d52-b9e7-77b7513848b0 with Priority: HIGHEST for action port [ 564.590151] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f45f03-4a5f-4d52-b9e7-77b7513848b0 with Priority: HIGHEST for action port [ 564.590151] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4f45f03-4a5f-4d52-b9e7-77b7513848b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.590151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4f45f03-4a5f-4d52-b9e7-77b7513848b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.590151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4f45f03-4a5f-4d52-b9e7-77b7513848b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.590151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4f45f03-4a5f-4d52-b9e7-77b7513848b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.590151] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4f45f03-4a5f-4d52-b9e7-77b7513848b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.648965] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67f587f7-4131-48e1-9f5a-029a3b5c8853 [ 564.648965] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.648965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.648965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.648965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.648965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.648965] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67f587f7-4131-48e1-9f5a-029a3b5c8853 already deleted. [ 564.648965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67f587f7-4131-48e1-9f5a-029a3b5c8853" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.986425] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.986425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.986425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.986425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.986425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.986425] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d already deleted. [ 564.986425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.095517] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4f45f03-4a5f-4d52-b9e7-77b7513848b0 [ 565.095929] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.096742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.096873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.097147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.097276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.097403] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4f45f03-4a5f-4d52-b9e7-77b7513848b0 already deleted. [ 565.097482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4f45f03-4a5f-4d52-b9e7-77b7513848b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.125909] env[64436]: INFO networking_nsxv3.common.synchronization [req-8f4f7d73-caea-4235-96ca-95ba541a0522 req-1f7fe685-9f06-4e61-b7d6-07f1d7491613 service nova] Enqueued Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_rules [ 565.127216] env[64436]: INFO networking_nsxv3.common.synchronization [req-8f4f7d73-caea-4235-96ca-95ba541a0522 req-1f7fe685-9f06-4e61-b7d6-07f1d7491613 service nova] Enqueued Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_members [ 565.127216] env[64436]: INFO networking_nsxv3.common.synchronization [req-8f4f7d73-caea-4235-96ca-95ba541a0522 req-1f7fe685-9f06-4e61-b7d6-07f1d7491613 service nova] Enqueued Resource ID: fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 with Priority: HIGHEST for action port [ 565.127640] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_rules [ 565.128632] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_members [ 565.128632] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 with Priority: HIGHEST for action port [ 565.128632] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.128632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.128632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.131557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.131557] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.131557] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc5500f-a0f5-4e87-aa9b-0020789243e9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.131557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.131557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.131557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.131557] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.131557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.132590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.132590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.132590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.132590] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.136787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.136787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.136787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.136787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.136787] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.242020] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-97 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.242020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-97" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.242020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-97" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.242020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-97" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.242743] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.242743] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.243117] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.243570] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.243891] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.244372] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 565.244516] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 565.244730] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 565.244801] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 565.244907] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 565.245031] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 565.245171] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 565.264098] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 565.264098] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 565.264098] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 565.264098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-97" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.264325] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-83a0e142-3575-4338-83cd-8113cdfcaebf taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.264325] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.264449] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.264789] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.264923] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83a0e142-3575-4338-83cd-8113cdfcaebf',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.306200] env[64436]: INFO networking_nsxv3.common.synchronization [req-54c99f4a-0f05-45aa-a9e5-a1301265ed4e req-08e46413-579c-4fea-98a3-0b8da7f3cc3e tempest-ServerDiagnosticsTest-544626028 tempest-ServerDiagnosticsTest-544626028-project-member] Enqueued Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_members [ 565.306200] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGHEST for action security_group_members [ 565.306548] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.306767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.308975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.309274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.309510] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.309658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.309748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.309991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.310141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.310269] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.336637] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 565.337500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.424656] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d9b1cfc4-072b-40d7-940f-d2ac8b348ac8 None None] Enqueued Resource ID: 71ebaa20-8996-4511-ad30-86733c6cfa28 with Priority: HIGHEST for action port [ 565.424971] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ebaa20-8996-4511-ad30-86733c6cfa28 with Priority: HIGHEST for action port [ 565.426012] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ebaa20-8996-4511-ad30-86733c6cfa28 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.426012] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ebaa20-8996-4511-ad30-86733c6cfa28" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.426012] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ebaa20-8996-4511-ad30-86733c6cfa28" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.426240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ebaa20-8996-4511-ad30-86733c6cfa28" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.426322] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ebaa20-8996-4511-ad30-86733c6cfa28',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.459891] env[64436]: INFO networking_nsxv3.common.synchronization [req-11402cfc-3916-4cae-9999-5ee5a5d9dfa3 req-e4215d8f-b41b-4c37-9697-fce75fb6997b tempest-ImagesNegativeTestJSON-975079101 tempest-ImagesNegativeTestJSON-975079101-project-member] Enqueued Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_members [ 565.461331] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_members [ 565.461797] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.461797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.461797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.462025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.462178] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.462278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.462337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.463203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.463203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.463203] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.637091] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.638248] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc5500f-a0f5-4e87-aa9b-0020789243e9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.638248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.638248] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 with status ACTIVE [ 565.638248] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.638248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.638248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.638248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.638503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.638503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.638592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.638647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.638789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.638863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.643933] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.643933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.643933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.643933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.643933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.643933] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7 is going to be updated. [ 565.662713] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.662864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.662962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.663145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.663309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.663469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb4bc1fd-5b86-4a7c-8a54-40e9c8474dc7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.767984] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.768220] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.768396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.768636] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.768858] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.768948] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 83a0e142-3575-4338-83cd-8113cdfcaebf not found, creating... [ 565.769225] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.769365] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.769485] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.769753] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.769845] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.773015] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.773015] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.773015] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.773015] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.773015] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.773015] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 83a0e142-3575-4338-83cd-8113cdfcaebf is going to be created. [ 565.799525] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.799788] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.799951] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.800255] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.800475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.800705] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.812298] env[64436]: INFO networking_nsxv3.common.synchronization [req-aad23b1e-0985-4bcc-9d15-a7875d02d5ca req-6d4a3273-5094-4872-8169-283f1bb334f5 tempest-ServerExternalEventsTest-600574363 tempest-ServerExternalEventsTest-600574363-project-member] Enqueued Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_members [ 565.812685] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.812834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.813430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.813430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.813430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.813430] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.813596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.815239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.815877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.815965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.816853] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a is going to be updated. [ 565.818460] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1017fee-6833-4760-849a-3861937d36d9 with Priority: HIGHEST for action security_group_members [ 565.818920] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1017fee-6833-4760-849a-3861937d36d9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.819159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.819315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.819587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.819818] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.820048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.820201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.820438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.820605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.820789] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1017fee-6833-4760-849a-3861937d36d9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.849797] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.849797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.849797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.849797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.849797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.857921] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a in Status: IN_PROGRESS for 2s [ 565.929653] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71ebaa20-8996-4511-ad30-86733c6cfa28 [ 565.929898] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.930056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.930130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.930355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.930448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.930543] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71ebaa20-8996-4511-ad30-86733c6cfa28 already deleted. [ 565.930629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ebaa20-8996-4511-ad30-86733c6cfa28" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.966030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.966163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.966163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.966335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.966422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.966632] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.966732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.966792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.966973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.967041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.967117] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 already deleted. [ 565.967196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.097524] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.097524] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-424" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.097850] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-424" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.098126] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-424" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.098995] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.099345] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.099636] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.100047] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.100591] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.104019] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 566.104019] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 566.104019] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 566.104019] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 566.104019] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 566.104019] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 566.104019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 566.128725] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 566.128974] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 566.129231] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 566.129507] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-424" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.129969] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-1bd7e059-3f3f-47b8-9e02-06214fa98e27 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.130249] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.130638] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.131129] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.131396] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bd7e059-3f3f-47b8-9e02-06214fa98e27',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.143920] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.326697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.326697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.326697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.326697] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1017fee-6833-4760-849a-3861937d36d9 is going to be updated. [ 566.356243] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.356392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.356578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.356721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.356876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.364664] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1017fee-6833-4760-849a-3861937d36d9 in Status: IN_PROGRESS for 2s [ 566.639336] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.639585] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.639715] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.640026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.640186] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.640344] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 1bd7e059-3f3f-47b8-9e02-06214fa98e27 not found, creating... [ 566.640607] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.640937] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.641144] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.641391] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.641546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.641862] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.642111] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.642266] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.642417] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.642554] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.642698] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 1bd7e059-3f3f-47b8-9e02-06214fa98e27 is going to be created. [ 566.646602] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.646782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.646782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.646943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.647038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.647130] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 is going to be created. [ 566.665610] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.666872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.670219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.670219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.670219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.670219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.672761] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.672915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.672915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.673156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.673349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.689797] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 in Status: UNINITIALIZED for 2s [ 566.720609] env[64436]: INFO networking_nsxv3.common.synchronization [req-233d9c84-dd81-494c-b13e-34c10b7dc8ed req-0861158a-6f2d-459f-9809-7127a656fdbb service nova] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_rules [ 566.720782] env[64436]: INFO networking_nsxv3.common.synchronization [req-233d9c84-dd81-494c-b13e-34c10b7dc8ed req-0861158a-6f2d-459f-9809-7127a656fdbb service nova] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_members [ 566.720924] env[64436]: INFO networking_nsxv3.common.synchronization [req-233d9c84-dd81-494c-b13e-34c10b7dc8ed req-0861158a-6f2d-459f-9809-7127a656fdbb service nova] Enqueued Resource ID: 83a0e142-3575-4338-83cd-8113cdfcaebf with Priority: HIGHEST for action port [ 566.721436] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_rules [ 566.721574] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_members [ 566.721869] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a0e142-3575-4338-83cd-8113cdfcaebf with Priority: HIGHEST for action port [ 566.721973] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.722176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.722288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.722511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.722595] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.723473] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.723610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.723665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.723855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.724155] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.724155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.724263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.724337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.724502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.724502] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.725882] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-83a0e142-3575-4338-83cd-8113cdfcaebf taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.725882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.725882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.726079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.726079] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83a0e142-3575-4338-83cd-8113cdfcaebf',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.227568] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.228609] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.228785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.229072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83a0e142-3575-4338-83cd-8113cdfcaebf with status ACTIVE [ 567.229239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.229353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.229823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.229823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.229823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.230123] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.230123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.230123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.230280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.230322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.230519] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.230625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.230687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.230827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.230957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.230989] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83a0e142-3575-4338-83cd-8113cdfcaebf is going to be updated. [ 567.257934] env[64436]: INFO networking_nsxv3.common.synchronization [req-b89ac0b4-cf3b-4a63-b395-f924d4dde901 req-e3e8f359-15f9-4221-897e-a5bc2fd3d708 tempest-ServersWithSpecificFlavorTestJSON-1646558451 tempest-ServersWithSpecificFlavorTestJSON-1646558451-project-member] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 567.265270] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.265445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.265488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.267543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.267543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.267543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83a0e142-3575-4338-83cd-8113cdfcaebf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.267543] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 567.267543] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.267543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.267543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.267543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.267543] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.267984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.267984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.267984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.267984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.267984] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.612389] env[64436]: INFO networking_nsxv3.common.synchronization [req-11402cfc-3916-4cae-9999-5ee5a5d9dfa3 req-ff4bbcb0-d609-480c-9b03-a386fb6579ff service nova] Enqueued Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_rules [ 567.613391] env[64436]: INFO networking_nsxv3.common.synchronization [req-11402cfc-3916-4cae-9999-5ee5a5d9dfa3 req-ff4bbcb0-d609-480c-9b03-a386fb6579ff service nova] Enqueued Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_members [ 567.613669] env[64436]: INFO networking_nsxv3.common.synchronization [req-11402cfc-3916-4cae-9999-5ee5a5d9dfa3 req-ff4bbcb0-d609-480c-9b03-a386fb6579ff service nova] Enqueued Resource ID: 1bd7e059-3f3f-47b8-9e02-06214fa98e27 with Priority: HIGHEST for action port [ 567.614538] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_rules [ 567.614924] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_members [ 567.615103] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd7e059-3f3f-47b8-9e02-06214fa98e27 with Priority: HIGHEST for action port [ 567.615894] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.616146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.616192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.616488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.616601] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.618851] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.618985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.619110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.619272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.619434] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.619538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.619807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.619969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.620075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.620170] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.621100] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bd7e059-3f3f-47b8-9e02-06214fa98e27 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.621326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.621326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.621463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.621519] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bd7e059-3f3f-47b8-9e02-06214fa98e27',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.730242] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.772488] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.772648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.772725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.772949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.773052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.773257] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.773369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.773443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.774019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.774019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.774019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc already deleted. [ 567.774019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.846139] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.846352] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.846506] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.846867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.847163] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.847325] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.847442] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.847673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.847806] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.850767] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 567.850767] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 567.850767] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 567.850767] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 567.850767] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 567.850767] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 567.850767] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 567.865812] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 567.866039] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 567.866201] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 567.866387] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.866798] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.866935] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.867046] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.867420] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.872093] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de423d63-a988-4ba6-a71b-32b1ce0bb6a1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.872093] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a in Status: SUCCESS [ 567.872093] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a deletion is rescheduled due to dependency. [ 567.872093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.972315] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d7dc442c-19b6-4bd3-9ef2-4aab5c69f065 None None] Enqueued Resource ID: 7e6f6d4d-fb9b-49fd-8db4-db1e42536195 with Priority: HIGHEST for action port [ 567.972588] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e6f6d4d-fb9b-49fd-8db4-db1e42536195 with Priority: HIGHEST for action port [ 567.973162] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e6f6d4d-fb9b-49fd-8db4-db1e42536195 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.973280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e6f6d4d-fb9b-49fd-8db4-db1e42536195" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.973347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e6f6d4d-fb9b-49fd-8db4-db1e42536195" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.974531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e6f6d4d-fb9b-49fd-8db4-db1e42536195" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.975840] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e6f6d4d-fb9b-49fd-8db4-db1e42536195',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.124272] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.124416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.124606] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bd7e059-3f3f-47b8-9e02-06214fa98e27 with status ACTIVE [ 568.124783] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.124888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.124950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.125170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.125256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.125421] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.125551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.125637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.125802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.125876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.126078] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.126167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.126225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.126360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.126431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.126514] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bd7e059-3f3f-47b8-9e02-06214fa98e27 is going to be updated. [ 568.129844] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.149292] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.149292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.149292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.149292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.149623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.149834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bd7e059-3f3f-47b8-9e02-06214fa98e27" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.232322] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.232650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.232650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.232821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.232864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.233176] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b966170-3dea-4773-8900-e7034ff19049 is going to be created. [ 568.267343] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.267343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.267343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.267343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.267343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.276375] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: UNINITIALIZED for 2s [ 568.370924] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.371201] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.371313] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.371541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.371684] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.371839] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port de423d63-a988-4ba6-a71b-32b1ce0bb6a1 not found, creating... [ 568.372098] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.372254] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.372368] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.372593] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.372741] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.373049] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.373204] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.373321] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.373622] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.373677] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.373784] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: de423d63-a988-4ba6-a71b-32b1ce0bb6a1 is going to be created. [ 568.375423] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1017fee-6833-4760-849a-3861937d36d9 in Status: SUCCESS [ 568.376116] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1017fee-6833-4760-849a-3861937d36d9 deletion is rescheduled due to dependency. [ 568.376116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1017fee-6833-4760-849a-3861937d36d9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.393023] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.393252] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.393367] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.393653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.393880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.394115] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.478160] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e6f6d4d-fb9b-49fd-8db4-db1e42536195 [ 568.478160] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.478160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.478160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.478414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.478448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.478984] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e6f6d4d-fb9b-49fd-8db4-db1e42536195 already deleted. [ 568.479234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e6f6d4d-fb9b-49fd-8db4-db1e42536195" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.631990] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.698525] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 in Status: SUCCESS [ 568.698739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.702341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.702578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.702772] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.702893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.702956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.703127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.703209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.703292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.703447] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.752172] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ae21051b-cee7-47e6-a1a4-c08a2dfb638a None None] Enqueued Resource ID: bcb70d39-1dc3-4ee0-8734-8d73c23a42b1 with Priority: HIGHEST for action port [ 568.752883] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb70d39-1dc3-4ee0-8734-8d73c23a42b1 with Priority: HIGHEST for action port [ 568.753290] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb70d39-1dc3-4ee0-8734-8d73c23a42b1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.753355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb70d39-1dc3-4ee0-8734-8d73c23a42b1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.753456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb70d39-1dc3-4ee0-8734-8d73c23a42b1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.754275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb70d39-1dc3-4ee0-8734-8d73c23a42b1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.754385] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb70d39-1dc3-4ee0-8734-8d73c23a42b1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.011379] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f6a66678-9dde-4489-a406-1731f9179366 None None] Enqueued Resource ID: abf05b3c-3a8a-4c27-ab05-51ab696912aa with Priority: HIGHEST for action port [ 569.012264] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf05b3c-3a8a-4c27-ab05-51ab696912aa with Priority: HIGHEST for action port [ 569.012525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-abf05b3c-3a8a-4c27-ab05-51ab696912aa taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.012716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abf05b3c-3a8a-4c27-ab05-51ab696912aa" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.012830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abf05b3c-3a8a-4c27-ab05-51ab696912aa" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.013196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abf05b3c-3a8a-4c27-ab05-51ab696912aa" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.013367] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abf05b3c-3a8a-4c27-ab05-51ab696912aa',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.135309] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.135309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.135309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.135500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.135500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.135606] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 is going to be created. [ 569.172021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.172021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.172021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.172021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.172021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.185626] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 in Status: UNINITIALIZED for 2s [ 569.207774] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.257783] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcb70d39-1dc3-4ee0-8734-8d73c23a42b1 [ 569.257783] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.257783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.257783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.257783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.257783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.257783] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcb70d39-1dc3-4ee0-8734-8d73c23a42b1 already deleted. [ 569.257783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb70d39-1dc3-4ee0-8734-8d73c23a42b1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.516322] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abf05b3c-3a8a-4c27-ab05-51ab696912aa [ 569.516754] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.516902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.517024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.517326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.517442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.517541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abf05b3c-3a8a-4c27-ab05-51ab696912aa already deleted. [ 569.517636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abf05b3c-3a8a-4c27-ab05-51ab696912aa" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.710516] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc5500f-a0f5-4e87-aa9b-0020789243e9: rpc.has_security_group_logging(os_id): False [ 569.729864] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.729864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.729864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.729864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.729864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.729864] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.729864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.729864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.730525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.730525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.730525] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 is going to be created. [ 569.752592] env[64436]: INFO networking_nsxv3.common.synchronization [req-b89ac0b4-cf3b-4a63-b395-f924d4dde901 req-70dd52bc-ed86-4148-a1da-a81c3ed4e54e service nova] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 569.753545] env[64436]: INFO networking_nsxv3.common.synchronization [req-b89ac0b4-cf3b-4a63-b395-f924d4dde901 req-70dd52bc-ed86-4148-a1da-a81c3ed4e54e service nova] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 569.753545] env[64436]: INFO networking_nsxv3.common.synchronization [req-b89ac0b4-cf3b-4a63-b395-f924d4dde901 req-70dd52bc-ed86-4148-a1da-a81c3ed4e54e service nova] Enqueued Resource ID: de423d63-a988-4ba6-a71b-32b1ce0bb6a1 with Priority: HIGHEST for action port [ 569.754084] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 569.754084] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 569.754084] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de423d63-a988-4ba6-a71b-32b1ce0bb6a1 with Priority: HIGHEST for action port [ 569.758226] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.758979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.758979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.758979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.758979] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.760367] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.761269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.761269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.761269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.761269] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.761269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.761269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.761583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.761583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.761583] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.762699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.762699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.762699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.762882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.762968] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de423d63-a988-4ba6-a71b-32b1ce0bb6a1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.783151] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.783298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.783356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.783614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.783748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.795743] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 in Status: IN_PROGRESS for 2s [ 570.265211] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.265651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.265651] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.267131] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de423d63-a988-4ba6-a71b-32b1ce0bb6a1 with status ACTIVE [ 570.267456] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.267544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.267583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.267821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.267947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.268170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.268281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.268342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.268599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.268698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.268942] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.269045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.269106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.269244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.269361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.269453] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de423d63-a988-4ba6-a71b-32b1ce0bb6a1 is going to be updated. [ 570.289579] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: SUCCESS [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.289579] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.289579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.289579] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.296572] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.296797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.296871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.297070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.297207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.297640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de423d63-a988-4ba6-a71b-32b1ce0bb6a1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.498750] env[64436]: INFO networking_nsxv3.common.synchronization [req-804a7593-9b38-437a-a418-803689704043 req-84161935-aa4e-4cc0-82a7-5f557ffd7c5d tempest-ServerAddressesTestJSON-1586530565 tempest-ServerAddressesTestJSON-1586530565-project-member] Enqueued Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_members [ 570.499397] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_members [ 570.499671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b915a177-2742-49be-9ca9-2dc30ee9c6ac taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.499797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.499862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.500140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.500419] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.500479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.501204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.501204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.501204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.501204] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.768530] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.790084] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.003912] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.004088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.004214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.004435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.004527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.004764] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.006169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.006226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.006445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.006538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.006641] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac already deleted. [ 571.006752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.192011] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 in Status: SUCCESS [ 571.192267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.192435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.192649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.192846] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.192965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.193046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.193202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.193285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.193371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.193473] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.274560] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.274930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.274930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.275153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.275252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.275384] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be created. [ 571.293063] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b966170-3dea-4773-8900-e7034ff19049: rpc.has_security_group_logging(os_id): False [ 571.301085] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.301259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.301325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.301561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.301727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.314805] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.316904] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.316904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.316904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b966170-3dea-4773-8900-e7034ff19049 is going to be created. [ 571.320032] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: UNINITIALIZED for 2s [ 571.373892] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.373892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.373892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.373892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.373892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.383392] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: IN_PROGRESS for 2s [ 571.697966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.698199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.698271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.698493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.698686] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.698792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.698858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.699028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.699126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.701948] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.701948] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.701948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.701948] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.763393] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.763584] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.763635] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.765276] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.765276] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.765510] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.765510] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.766672] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.766672] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.766672] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.766672] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 571.766672] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 571.766920] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 571.766920] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.766920] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 571.767054] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 571.787574] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 571.787574] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 571.787574] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 571.787574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.787574] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.787574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.787574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.787574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.787574] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5322c41d-3290-4b6e-8d83-697bd4c9e2fd',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.806414] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 in Status: SUCCESS [ 571.806414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.077912] env[64436]: INFO networking_nsxv3.common.synchronization [None req-e61373b5-fa04-46f4-a85b-c697715e614f None None] Enqueued Resource ID: fb6a9576-1ff1-402c-8fa4-e1a395896f1c with Priority: HIGHEST for action port [ 572.078457] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6a9576-1ff1-402c-8fa4-e1a395896f1c with Priority: HIGHEST for action port [ 572.078768] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6a9576-1ff1-402c-8fa4-e1a395896f1c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.078922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6a9576-1ff1-402c-8fa4-e1a395896f1c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.078955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6a9576-1ff1-402c-8fa4-e1a395896f1c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.080215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6a9576-1ff1-402c-8fa4-e1a395896f1c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.080305] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6a9576-1ff1-402c-8fa4-e1a395896f1c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.208410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00: rpc.has_security_group_logging(os_id): False [ 572.227487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.227487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.227487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.228057] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.228057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.228057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.228057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.228057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.228386] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.230838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.230838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.230838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.230838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.230838] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 is going to be created. [ 572.290582] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.290861] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.291000] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.291255] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.291403] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.291560] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 5322c41d-3290-4b6e-8d83-697bd4c9e2fd not found, creating... [ 572.291834] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.291991] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.292131] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.292368] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.292496] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.292789] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.292954] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.294202] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.294458] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.294605] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.294750] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 5322c41d-3290-4b6e-8d83-697bd4c9e2fd is going to be created. [ 572.296826] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.296934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.297000] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.297913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.298139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.309760] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 in Status: IN_PROGRESS for 2s [ 572.316180] env[64436]: INFO networking_nsxv3.common.synchronization [None req-c76b4fe5-7687-4777-a741-91fcd185271e None None] Enqueued Resource ID: 00193125-ed56-4d6e-b0f0-fce8b4640fcf with Priority: HIGHEST for action port [ 572.316428] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00193125-ed56-4d6e-b0f0-fce8b4640fcf with Priority: HIGHEST for action port [ 572.317785] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-00193125-ed56-4d6e-b0f0-fce8b4640fcf taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.318955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00193125-ed56-4d6e-b0f0-fce8b4640fcf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.319066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00193125-ed56-4d6e-b0f0-fce8b4640fcf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.319337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00193125-ed56-4d6e-b0f0-fce8b4640fcf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.319417] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00193125-ed56-4d6e-b0f0-fce8b4640fcf',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.325274] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.325453] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.325599] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.325904] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.326162] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.326387] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.489252] env[64436]: INFO networking_nsxv3.common.synchronization [None req-da08bff3-20b5-45a2-bbb6-69f1cf9cd352 None None] Enqueued Resource ID: b7f0a712-1aeb-474c-aada-88a9acb5ce1f with Priority: HIGHEST for action port [ 572.489827] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f0a712-1aeb-474c-aada-88a9acb5ce1f with Priority: HIGHEST for action port [ 572.490299] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f0a712-1aeb-474c-aada-88a9acb5ce1f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.490403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f0a712-1aeb-474c-aada-88a9acb5ce1f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.490551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f0a712-1aeb-474c-aada-88a9acb5ce1f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.490864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f0a712-1aeb-474c-aada-88a9acb5ce1f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.491047] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f0a712-1aeb-474c-aada-88a9acb5ce1f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.582051] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb6a9576-1ff1-402c-8fa4-e1a395896f1c [ 572.582394] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.585291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.585291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.585291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.585291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.585291] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb6a9576-1ff1-402c-8fa4-e1a395896f1c already deleted. [ 572.585291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6a9576-1ff1-402c-8fa4-e1a395896f1c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.828229] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00193125-ed56-4d6e-b0f0-fce8b4640fcf [ 572.828463] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.828606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.832022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.832022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.832022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.832022] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00193125-ed56-4d6e-b0f0-fce8b4640fcf already deleted. [ 572.832022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00193125-ed56-4d6e-b0f0-fce8b4640fcf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.993234] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7f0a712-1aeb-474c-aada-88a9acb5ce1f [ 572.993909] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.995152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.995152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.995152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.995152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.995152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7f0a712-1aeb-474c-aada-88a9acb5ce1f already deleted. [ 572.995152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f0a712-1aeb-474c-aada-88a9acb5ce1f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.331026] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.331026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.331026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.331026] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.395758] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: SUCCESS [ 573.396106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.624904] env[64436]: INFO networking_nsxv3.common.synchronization [req-804a7593-9b38-437a-a418-803689704043 req-091b16c4-ef7f-4e43-a3b6-bf3eb0337ada service nova] Enqueued Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_rules [ 573.625181] env[64436]: INFO networking_nsxv3.common.synchronization [req-804a7593-9b38-437a-a418-803689704043 req-091b16c4-ef7f-4e43-a3b6-bf3eb0337ada service nova] Enqueued Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_members [ 573.625564] env[64436]: INFO networking_nsxv3.common.synchronization [req-804a7593-9b38-437a-a418-803689704043 req-091b16c4-ef7f-4e43-a3b6-bf3eb0337ada service nova] Enqueued Resource ID: 5322c41d-3290-4b6e-8d83-697bd4c9e2fd with Priority: HIGHEST for action port [ 573.626214] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_rules [ 573.626347] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_members [ 573.626471] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5322c41d-3290-4b6e-8d83-697bd4c9e2fd with Priority: HIGHEST for action port [ 573.626816] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b915a177-2742-49be-9ca9-2dc30ee9c6ac taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.627728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.627801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.628320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.628396] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.630418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b915a177-2742-49be-9ca9-2dc30ee9c6ac taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.630579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.630660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.630890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.631092] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.631217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.631283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.631481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.631574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.631695] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.635137] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.635137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.635137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.635137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.635137] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5322c41d-3290-4b6e-8d83-697bd4c9e2fd',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.834314] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.043350] env[64436]: INFO networking_nsxv3.common.synchronization [None req-2995964d-8df3-4604-b7ff-25ef20156eee tempest-VolumesAdminNegativeTest-1750673227 tempest-VolumesAdminNegativeTest-1750673227-project-member] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_rules [ 574.043350] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_rules [ 574.043653] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.043756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.043813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.044440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.044440] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.140623] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.142237] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b915a177-2742-49be-9ca9-2dc30ee9c6ac taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.142416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.142565] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5322c41d-3290-4b6e-8d83-697bd4c9e2fd with status ACTIVE [ 574.142776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.142903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.142969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.143337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.143337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.143532] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.143623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.143682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.143898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.143898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.145614] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.145614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.145614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.145614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.145614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.145614] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5322c41d-3290-4b6e-8d83-697bd4c9e2fd is going to be updated. [ 574.166748] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.166978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.168835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.169133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.169288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.169496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5322c41d-3290-4b6e-8d83-697bd4c9e2fd" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.217322] env[64436]: INFO networking_nsxv3.common.synchronization [None req-bbdfe890-5871-4860-9c39-fbb48ffde74d tempest-VolumesAdminNegativeTest-1750673227 tempest-VolumesAdminNegativeTest-1750673227-project-member] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_rules [ 574.219289] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_rules [ 574.219999] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.219999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.329767] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 in Status: SUCCESS [ 574.331179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.340201] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2392c42b-4327-4a1f-85ce-846d4a8981fc: rpc.has_security_group_logging(os_id): False [ 574.362830] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.363057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.363057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.363279] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.363375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.363661] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.363941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.363991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.364142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.364239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.364322] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be created. [ 574.436329] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.436755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.436902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.437207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.437528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.457259] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: IN_PROGRESS for 2s [ 574.571247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.571454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.571529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.571792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.571922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.572064] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 already deleted. [ 574.572314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.572429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.572632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.572758] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.607762] env[64436]: INFO networking_nsxv3.common.synchronization [req-7291043d-d77d-46b7-ab6c-0fd6e5a9be51 req-e57268ba-2f39-4170-a0ca-a0d80dfccc02 tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 574.609457] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 574.609876] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.610270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.610270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.610667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.610975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.611291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.611639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.612087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.612087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.612087] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.647834] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.763747] env[64436]: INFO networking_nsxv3.common.synchronization [None req-eece5204-d0f6-46fc-ab72-62505aa192d5 None None] Enqueued Resource ID: 3278440a-1aa6-4c7b-bd84-200224b657b8 with Priority: HIGHEST for action port [ 574.764031] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3278440a-1aa6-4c7b-bd84-200224b657b8 with Priority: HIGHEST for action port [ 574.764611] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3278440a-1aa6-4c7b-bd84-200224b657b8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.764728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3278440a-1aa6-4c7b-bd84-200224b657b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.765135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3278440a-1aa6-4c7b-bd84-200224b657b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.768253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3278440a-1aa6-4c7b-bd84-200224b657b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.768352] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3278440a-1aa6-4c7b-bd84-200224b657b8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.099439] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.099680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.099680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.099883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.099970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.100076] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 already deleted. [ 575.100158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.114792] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.114970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.115051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.115286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.115380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.115587] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.115716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.115782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.115933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.116019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.116107] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 already deleted. [ 575.116211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.151092] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.151898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.155167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.155401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.155538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.155619] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac is going to be created. [ 575.181182] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.181182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.181182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.181182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.181182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.190906] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac in Status: UNINITIALIZED for 2s [ 575.273163] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3278440a-1aa6-4c7b-bd84-200224b657b8 [ 575.273163] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.273163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.273163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.273163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.273163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.273163] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3278440a-1aa6-4c7b-bd84-200224b657b8 already deleted. [ 575.273163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3278440a-1aa6-4c7b-bd84-200224b657b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.074315] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.074315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.074315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.074315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.074315] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.074315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.074315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.077386] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.077577] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.077802] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 576.077920] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 576.078068] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 576.078180] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 576.078291] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 576.078396] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 576.078882] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 576.110394] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 576.110643] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 576.110847] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 576.111064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.111416] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d415e246-cb6d-47d8-8a97-99252eace5d2 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.111599] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.111768] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.112083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.112229] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d415e246-cb6d-47d8-8a97-99252eace5d2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.469669] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 576.473426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.615503] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.616578] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.616811] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.617160] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.617385] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.618073] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d415e246-cb6d-47d8-8a97-99252eace5d2 not found, creating... [ 576.618682] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.619128] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.619204] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.619534] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.619933] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.621203] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.621203] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.621203] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.621407] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.621685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.621899] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d415e246-cb6d-47d8-8a97-99252eace5d2 is going to be created. [ 576.640703] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.640980] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.641179] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.641516] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.641774] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.642184] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.890657] env[64436]: INFO networking_nsxv3.common.synchronization [None req-9cda3f3b-aa13-4ed0-b810-c8aafdfee79f None None] Enqueued Resource ID: af465bd9-ac58-4330-bc19-52acb79286c3 with Priority: HIGHEST for action port [ 576.891381] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af465bd9-ac58-4330-bc19-52acb79286c3 with Priority: HIGHEST for action port [ 576.891769] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-af465bd9-ac58-4330-bc19-52acb79286c3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.891954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af465bd9-ac58-4330-bc19-52acb79286c3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.891954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af465bd9-ac58-4330-bc19-52acb79286c3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.893403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af465bd9-ac58-4330-bc19-52acb79286c3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.893694] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af465bd9-ac58-4330-bc19-52acb79286c3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.174984] env[64436]: INFO networking_nsxv3.common.synchronization [req-63e39ce1-e17d-496d-b2f3-fd3d618c0efe req-f81f87d8-82fe-4ca0-81db-9972a5425be1 tempest-ServersAdminNegativeTestJSON-837803547 tempest-ServersAdminNegativeTestJSON-837803547-project-member] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 577.176382] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 577.178592] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.178592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.178592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.178592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.178837] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.178986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.179044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.179271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.179331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.179377] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.200827] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac in Status: SUCCESS [ 577.201049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.201206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.201539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.201637] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.201734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.201809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.201960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.202048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.202131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.202217] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.399716] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af465bd9-ac58-4330-bc19-52acb79286c3 [ 577.399922] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.400066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.400142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.400364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.400467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.400613] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af465bd9-ac58-4330-bc19-52acb79286c3 already deleted. [ 577.400660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af465bd9-ac58-4330-bc19-52acb79286c3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.681598] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.700542] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b67ec819-216c-419e-90ba-94e96ff2285d None None] Enqueued Resource ID: 738fa7b1-c758-4c53-b730-0dcd7bc2bc01 with Priority: HIGHEST for action port [ 577.700793] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738fa7b1-c758-4c53-b730-0dcd7bc2bc01 with Priority: HIGHEST for action port [ 577.701338] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-738fa7b1-c758-4c53-b730-0dcd7bc2bc01 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.701537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738fa7b1-c758-4c53-b730-0dcd7bc2bc01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.701537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738fa7b1-c758-4c53-b730-0dcd7bc2bc01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.701792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738fa7b1-c758-4c53-b730-0dcd7bc2bc01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.701941] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738fa7b1-c758-4c53-b730-0dcd7bc2bc01',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.704945] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b915a177-2742-49be-9ca9-2dc30ee9c6ac taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.704945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.704945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.705210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.705727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.705727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.705727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.705727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.705727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.705976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.705976] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b915a177-2742-49be-9ca9-2dc30ee9c6ac taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.705976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.706701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.706701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.706701] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.706701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.706701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.706701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.706701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.707038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.707038] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.800672] env[64436]: INFO networking_nsxv3.common.synchronization [req-7291043d-d77d-46b7-ab6c-0fd6e5a9be51 req-39d1caf5-8af9-4670-9ba1-5d41b5d405a3 service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 577.800672] env[64436]: INFO networking_nsxv3.common.synchronization [req-7291043d-d77d-46b7-ab6c-0fd6e5a9be51 req-39d1caf5-8af9-4670-9ba1-5d41b5d405a3 service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 577.800672] env[64436]: INFO networking_nsxv3.common.synchronization [req-7291043d-d77d-46b7-ab6c-0fd6e5a9be51 req-39d1caf5-8af9-4670-9ba1-5d41b5d405a3 service nova] Enqueued Resource ID: d415e246-cb6d-47d8-8a97-99252eace5d2 with Priority: HIGHEST for action port [ 577.800672] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 577.800672] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 577.803289] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d415e246-cb6d-47d8-8a97-99252eace5d2 with Priority: HIGHEST for action port [ 577.803289] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.803589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.803589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.803866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.803949] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.805041] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.805041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.805213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.805268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.805444] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.805563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.805646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.805834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.805926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.807440] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.810070] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d415e246-cb6d-47d8-8a97-99252eace5d2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.810070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.810070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.810070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.810070] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d415e246-cb6d-47d8-8a97-99252eace5d2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.886027] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.886027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.886027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.886027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.886314] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.886488] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.886565] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.886817] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.886968] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.887205] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.887320] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 577.887426] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 577.887550] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 577.887678] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.887780] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 577.887907] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 577.904887] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 577.905073] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 577.905215] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 577.905386] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.905754] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b86988a8-37ab-4fca-a5cb-819acb362cce taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.905935] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.906087] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.906416] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.906555] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b86988a8-37ab-4fca-a5cb-819acb362cce',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.186919] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.204326] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 738fa7b1-c758-4c53-b730-0dcd7bc2bc01 [ 578.204326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.204492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.204492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.207017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.207017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.207017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:738fa7b1-c758-4c53-b730-0dcd7bc2bc01 already deleted. [ 578.207017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738fa7b1-c758-4c53-b730-0dcd7bc2bc01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.208860] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b915a177-2742-49be-9ca9-2dc30ee9c6ac: rpc.has_security_group_logging(os_id): False [ 578.229399] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.229826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.229826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.230097] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.230458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.231026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.231026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.231026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.231026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.231368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.231368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.231368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.231474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.231729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.231729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.231808] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.231899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.231958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.234234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.236044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.236044] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac is going to be created. [ 578.293707] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.293707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.293707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.293954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.293954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.307775] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac in Status: IN_PROGRESS for 2s [ 578.311045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.311563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.316968] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.317779] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d415e246-cb6d-47d8-8a97-99252eace5d2 with status ACTIVE [ 578.317779] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.317964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.318024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.318323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.318506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.318734] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.318899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.318966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.319886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.320080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.321358] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.321358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.321358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.321358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.321358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.321358] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d415e246-cb6d-47d8-8a97-99252eace5d2 is going to be updated. [ 578.354400] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.354734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.354904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.358030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.358030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.358030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d415e246-cb6d-47d8-8a97-99252eace5d2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.409935] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.410177] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.410302] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.410874] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.411066] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.411234] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b86988a8-37ab-4fca-a5cb-819acb362cce not found, creating... [ 578.411527] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.411704] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.411822] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.412063] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.412192] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.412460] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.412616] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.412723] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.413641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.416231] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.416377] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b86988a8-37ab-4fca-a5cb-819acb362cce is going to be created. [ 578.461468] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.461468] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.461468] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.461468] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.461468] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.461468] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.689173] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.689367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.689488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.689906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.690666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.690666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7502962-276d-43f0-96f0-2447f12d3137 is going to be updated. [ 578.725687] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.725891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.725891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.726128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.726276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.737438] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: IN_PROGRESS for 2s [ 578.824445] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.330370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.330682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.330682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.330864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.330961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.331064] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be created. [ 579.356104] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.356104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.356104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.356104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.356505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.368373] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: UNINITIALIZED for 2s [ 579.625560] env[64436]: INFO networking_nsxv3.common.synchronization [req-63e39ce1-e17d-496d-b2f3-fd3d618c0efe req-1d8d6f54-0fd4-42f5-b94f-82d4f229bd37 service nova] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_rules [ 579.625560] env[64436]: INFO networking_nsxv3.common.synchronization [req-63e39ce1-e17d-496d-b2f3-fd3d618c0efe req-1d8d6f54-0fd4-42f5-b94f-82d4f229bd37 service nova] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 579.625560] env[64436]: INFO networking_nsxv3.common.synchronization [req-63e39ce1-e17d-496d-b2f3-fd3d618c0efe req-1d8d6f54-0fd4-42f5-b94f-82d4f229bd37 service nova] Enqueued Resource ID: b86988a8-37ab-4fca-a5cb-819acb362cce with Priority: HIGHEST for action port [ 579.625791] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_rules [ 579.626671] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 579.626671] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86988a8-37ab-4fca-a5cb-819acb362cce with Priority: HIGHEST for action port [ 579.627524] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.627595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.627945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.627945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.628076] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.632478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.632478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.632478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b86988a8-37ab-4fca-a5cb-819acb362cce taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.632478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.632478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.632478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.632478] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b86988a8-37ab-4fca-a5cb-819acb362cce',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.835721] env[64436]: INFO networking_nsxv3.common.synchronization [req-60afb45f-9661-4670-9339-094d3c46a96f req-633a09ee-e52c-4bcf-be89-247785d79e86 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 579.836355] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 579.836668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.836792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.836855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.837688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.837739] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.837861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.837925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.838197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.838274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.838327] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.130973] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.131146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.136579] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b86988a8-37ab-4fca-a5cb-819acb362cce with status ACTIVE [ 580.136856] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.136956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.137037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.137251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.137346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.137520] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.137632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.138402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.138402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.138402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.138512] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.138567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.138603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.138740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.138881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.138945] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b86988a8-37ab-4fca-a5cb-819acb362cce is going to be updated. [ 580.161205] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.161353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.161427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.161654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.161895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.162080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b86988a8-37ab-4fca-a5cb-819acb362cce" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.217258] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.218306] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.218633] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.221022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.221022] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.221022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.221022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.221022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.225020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.225020] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 580.225020] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 580.225020] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 580.225020] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 580.225020] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 580.225020] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 580.225020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 580.268782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 580.268782] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 580.268782] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 580.268782] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.268782] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-0496d996-77fe-4a95-8f55-282de9be2311 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.269255] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.269255] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.269944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.269944] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0496d996-77fe-4a95-8f55-282de9be2311',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.320331] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac in Status: SUCCESS [ 580.320331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.342782] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.342782] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.342782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 already deleted. [ 580.343803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.718727] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d784ddd7-ca4e-4c3c-804d-c093d2c61688 None None] Enqueued Resource ID: 70aea750-9a58-49ea-9634-10d6588e3e9d with Priority: HIGHEST for action port [ 580.718727] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70aea750-9a58-49ea-9634-10d6588e3e9d with Priority: HIGHEST for action port [ 580.718727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-70aea750-9a58-49ea-9634-10d6588e3e9d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.718727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70aea750-9a58-49ea-9634-10d6588e3e9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.718727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70aea750-9a58-49ea-9634-10d6588e3e9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.718727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70aea750-9a58-49ea-9634-10d6588e3e9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.718727] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70aea750-9a58-49ea-9634-10d6588e3e9d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.747418] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: SUCCESS [ 580.748330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.748330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.748330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.748330] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.748545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.748545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.748614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.748648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.748735] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.774019] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.774428] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.774428] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.774683] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.774928] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.774997] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 0496d996-77fe-4a95-8f55-282de9be2311 not found, creating... [ 580.775526] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.775819] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.775926] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.776250] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.776370] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.780167] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.780167] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.780167] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.780167] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.780167] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.780167] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 0496d996-77fe-4a95-8f55-282de9be2311 is going to be created. [ 580.797999] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.797999] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.797999] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.798746] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.798746] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.798746] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.218530] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70aea750-9a58-49ea-9634-10d6588e3e9d [ 581.219138] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.219762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.219888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.220243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.220384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.220543] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70aea750-9a58-49ea-9634-10d6588e3e9d already deleted. [ 581.220689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70aea750-9a58-49ea-9634-10d6588e3e9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.253293] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.383248] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 581.383248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.383248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.383931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.383931] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.383931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.383931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.384310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.384310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.384413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.384445] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.455631] env[64436]: INFO networking_nsxv3.common.synchronization [None req-06bfaf14-f7df-41e1-a2e9-7d873c767b8f None None] Enqueued Resource ID: 2c7737a3-2ff2-43cc-91bc-67df52d72353 with Priority: HIGHEST for action port [ 581.456334] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c7737a3-2ff2-43cc-91bc-67df52d72353 with Priority: HIGHEST for action port [ 581.457024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c7737a3-2ff2-43cc-91bc-67df52d72353 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.457024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c7737a3-2ff2-43cc-91bc-67df52d72353" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.457024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c7737a3-2ff2-43cc-91bc-67df52d72353" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.459768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c7737a3-2ff2-43cc-91bc-67df52d72353" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.459768] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c7737a3-2ff2-43cc-91bc-67df52d72353',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.669986] env[64436]: INFO networking_nsxv3.common.synchronization [req-f244b89d-62ae-4960-abf2-8d3f1586c3ea req-2eb058df-898f-4ec4-ab87-6c3f289ec447 tempest-SecurityGroupRulesTestJSON-1458343354 tempest-SecurityGroupRulesTestJSON-1458343354-project-member] Enqueued Resource ID: 6b03f006-7798-4f8e-9c5d-a0c75e45ad80 with Priority: HIGHEST for action security_group_rules [ 581.670242] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b03f006-7798-4f8e-9c5d-a0c75e45ad80 with Priority: HIGHEST for action security_group_rules [ 581.670549] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b03f006-7798-4f8e-9c5d-a0c75e45ad80 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.670678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b03f006-7798-4f8e-9c5d-a0c75e45ad80" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.670747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b03f006-7798-4f8e-9c5d-a0c75e45ad80" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.671019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b03f006-7798-4f8e-9c5d-a0c75e45ad80" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.671306] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b03f006-7798-4f8e-9c5d-a0c75e45ad80',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.758242] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.803902] env[64436]: INFO networking_nsxv3.common.synchronization [req-60afb45f-9661-4670-9339-094d3c46a96f req-76d6bdb2-3d29-4bd7-b68e-0004c15dcce2 service nova] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 581.803902] env[64436]: INFO networking_nsxv3.common.synchronization [req-60afb45f-9661-4670-9339-094d3c46a96f req-76d6bdb2-3d29-4bd7-b68e-0004c15dcce2 service nova] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 581.803902] env[64436]: INFO networking_nsxv3.common.synchronization [req-60afb45f-9661-4670-9339-094d3c46a96f req-76d6bdb2-3d29-4bd7-b68e-0004c15dcce2 service nova] Enqueued Resource ID: 0496d996-77fe-4a95-8f55-282de9be2311 with Priority: HIGHEST for action port [ 581.803902] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 581.803902] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 581.804620] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0496d996-77fe-4a95-8f55-282de9be2311 with Priority: HIGHEST for action port [ 581.805144] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.805469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.806351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.806351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.806351] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.809513] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.809513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.809513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.809698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.809799] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.809879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.810024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.810512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.810512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.810512] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.813324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-0496d996-77fe-4a95-8f55-282de9be2311 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.813324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.813324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.813324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.813324] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0496d996-77fe-4a95-8f55-282de9be2311',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.891124] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.891124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.891124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.891865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.891865] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.891865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.891865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.891865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.892225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.892225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.892225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.892381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.892433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.892694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.892914] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.893076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.893195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.893429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.893591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.893777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.893917] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.963017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c7737a3-2ff2-43cc-91bc-67df52d72353 [ 581.963017] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.963017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.963017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.963017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.963017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.963017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c7737a3-2ff2-43cc-91bc-67df52d72353 already deleted. [ 581.963017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c7737a3-2ff2-43cc-91bc-67df52d72353" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.195250] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.195250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.195250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.195250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.195250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.195250] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b03f006-7798-4f8e-9c5d-a0c75e45ad80 already deleted. [ 582.195250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b03f006-7798-4f8e-9c5d-a0c75e45ad80" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.262135] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.262542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.262724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.263053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.264825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.264825] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7502962-276d-43f0-96f0-2447f12d3137 is going to be updated. [ 582.294287] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.294287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.294287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.294287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.294287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.301655] env[64436]: INFO networking_nsxv3.common.synchronization [req-111da662-4ec5-4da3-ba4f-dbaa2a1d3773 req-2c41b44a-79b8-4fd8-a46b-8b1220e1c53f tempest-ImagesNegativeTestJSON-975079101 tempest-ImagesNegativeTestJSON-975079101-project-member] Enqueued Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_members [ 582.302244] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: IN_PROGRESS for 2s [ 582.302409] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGHEST for action security_group_members [ 582.302713] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.302835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.302903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.303601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.303796] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.303904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.303969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.304222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.304364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.304468] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.315671] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.318429] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.318564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.320402] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0496d996-77fe-4a95-8f55-282de9be2311 with status ACTIVE [ 582.320596] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.320708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.320772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.320969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.321068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.321230] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.321318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.321406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.321586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.321638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.321778] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.321879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.321931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.322204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.322290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.322374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0496d996-77fe-4a95-8f55-282de9be2311 is going to be updated. [ 582.344972] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.344972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.344972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.344972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.344972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.344972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.400217] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeeb0085-3d91-4859-b6e8-d553406b2219: rpc.has_security_group_logging(os_id): False [ 582.419445] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.419592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.419663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.419883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.419975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.420175] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.420275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.420338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.420490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.420634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.420771] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.420866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.420923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.421161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.421243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.421432] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.421526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.421581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.421723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.421797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.421879] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be created. [ 582.520087] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.520295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.520390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.520667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.520889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.534855] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 582.812423] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.812423] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.812423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.812423] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 is going to be updated. [ 582.820349] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.838809] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.839144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.839144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.839382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.839451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.848366] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 in Status: IN_PROGRESS for 2s [ 583.328542] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.329433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.329433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.329888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.329888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.329888] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be created. [ 583.360233] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.360233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.360233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.360526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.360611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.374075] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: UNINITIALIZED for 2s [ 583.487277] env[64436]: INFO networking_nsxv3.common.synchronization [req-3051f1e2-8fa8-4386-ab5b-7b59cdd13bb2 req-be1d7c34-2ed0-42f8-96b0-1b119134af54 tempest-SecurityGroupRulesTestJSON-1458343354 tempest-SecurityGroupRulesTestJSON-1458343354-project-member] Enqueued Resource ID: 1faa3794-fa96-432a-9a5b-863e028afd77 with Priority: HIGHEST for action security_group_rules [ 583.487837] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1faa3794-fa96-432a-9a5b-863e028afd77 with Priority: HIGHEST for action security_group_rules [ 583.488534] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1faa3794-fa96-432a-9a5b-863e028afd77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.488653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1faa3794-fa96-432a-9a5b-863e028afd77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.488653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1faa3794-fa96-432a-9a5b-863e028afd77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.488896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1faa3794-fa96-432a-9a5b-863e028afd77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.488979] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1faa3794-fa96-432a-9a5b-863e028afd77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.034487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.034487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.034487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.034487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.034487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.034487] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1faa3794-fa96-432a-9a5b-863e028afd77 already deleted. [ 584.034487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1faa3794-fa96-432a-9a5b-863e028afd77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.313535] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: SUCCESS [ 584.313960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.314959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.315301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.315829] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.316062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.316347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.316620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.319888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.319888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.319888] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.549686] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 584.549686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.822858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.822858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.822858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.822858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.822858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.822858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.822858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.822858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.822858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.823866] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.823866] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.823866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.824214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.825763] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.858966] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 in Status: SUCCESS [ 584.858966] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 deletion is rescheduled due to dependency. [ 584.858966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.330261] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7502962-276d-43f0-96f0-2447f12d3137: rpc.has_security_group_logging(os_id): False [ 585.349982] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.349982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.349982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.349982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.349982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.350257] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.350257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.350257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.350492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.350492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.350702] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.350782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.350823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.350957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.351039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.351211] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.351301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.351355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.351488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.351558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.351642] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7502962-276d-43f0-96f0-2447f12d3137 is going to be updated. [ 585.382583] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 585.382796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.383782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.383782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.384157] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.384157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.384157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.384338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.384379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.384452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.384551] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.411257] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.411452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.411498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.411685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.412451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.425192] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: IN_PROGRESS for 2s [ 585.889550] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.889992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.889992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.889992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.890200] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.890200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.890291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.890404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.890496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.890587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.890751] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.890888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.890954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.891136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.891284] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.891430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.891430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.891570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.891651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.891734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.891824] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.324356] env[64436]: INFO networking_nsxv3.common.synchronization [req-f452df8d-eebb-439d-8175-f0618258b368 req-aedfd176-2176-4533-9c84-7f9772c17104 tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 586.324828] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 586.327427] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.328024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.328024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.328024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.328024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.328454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.328454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.328454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.328454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.328582] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.398982] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9741d578-5b29-42b0-b0b6-dfd97b1c7306: rpc.has_security_group_logging(os_id): False [ 586.415823] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.415823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.415823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.416778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.416778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.416778] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.416778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.416778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.416778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.416778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.417327] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.417327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.417327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.417744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.417744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.417744] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.417865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.418055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.418393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.418393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.418605] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be created. [ 586.470165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.470519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.470813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.471300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.471580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.485827] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 586.830991] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.835160] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.835283] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.835338] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.835590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.835907] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.836081] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.836199] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.836447] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.836651] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.836964] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 586.841637] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.841786] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.841904] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.842043] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 586.842158] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.844343] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.861362] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.861445] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 586.861598] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.861770] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.862112] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d32aea38-4b8b-44ab-a80e-62bdad775bd5 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.862306] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.862412] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.862758] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.862899] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d32aea38-4b8b-44ab-a80e-62bdad775bd5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.254490] env[64436]: INFO networking_nsxv3.common.synchronization [req-f59445d7-5309-41b8-b894-f8556b721087 req-4916c515-b3c8-45b5-8df9-a9bd8bcc6868 tempest-SecurityGroupRulesTestJSON-1458343354 tempest-SecurityGroupRulesTestJSON-1458343354-project-member] Enqueued Resource ID: 6b82d99b-c878-4b4a-a285-3797032c495b with Priority: HIGHEST for action security_group_rules [ 587.255277] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b82d99b-c878-4b4a-a285-3797032c495b with Priority: HIGHEST for action security_group_rules [ 587.255494] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b82d99b-c878-4b4a-a285-3797032c495b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.255652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b82d99b-c878-4b4a-a285-3797032c495b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.255844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b82d99b-c878-4b4a-a285-3797032c495b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.256100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b82d99b-c878-4b4a-a285-3797032c495b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.256163] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b82d99b-c878-4b4a-a285-3797032c495b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.334878] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.367617] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.367906] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.368844] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.368844] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.368844] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.368844] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d32aea38-4b8b-44ab-a80e-62bdad775bd5 not found, creating... [ 587.368844] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.369245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.369245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.369401] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.369536] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.370040] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.370040] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.370360] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.371843] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.371843] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.371843] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d32aea38-4b8b-44ab-a80e-62bdad775bd5 is going to be created. [ 587.391498] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.391733] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.391852] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.393379] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.393379] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.393379] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.448970] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: SUCCESS [ 587.448970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.775888] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.776068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.776068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.776339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.776441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.776541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b82d99b-c878-4b4a-a285-3797032c495b already deleted. [ 587.776625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b82d99b-c878-4b4a-a285-3797032c495b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.836351] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.836499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.836568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.836944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.837089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.837204] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 587.864863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.865055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.865149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.869509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.869562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.878209] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 588.181487] env[64436]: INFO networking_nsxv3.common.synchronization [req-f452df8d-eebb-439d-8175-f0618258b368 req-f9bcac8e-ec6d-4127-b19c-cf4ebe355bce service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 588.181738] env[64436]: INFO networking_nsxv3.common.synchronization [req-f452df8d-eebb-439d-8175-f0618258b368 req-f9bcac8e-ec6d-4127-b19c-cf4ebe355bce service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 588.181890] env[64436]: INFO networking_nsxv3.common.synchronization [req-f452df8d-eebb-439d-8175-f0618258b368 req-f9bcac8e-ec6d-4127-b19c-cf4ebe355bce service nova] Enqueued Resource ID: d32aea38-4b8b-44ab-a80e-62bdad775bd5 with Priority: HIGHEST for action port [ 588.182443] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 588.182785] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 588.182785] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32aea38-4b8b-44ab-a80e-62bdad775bd5 with Priority: HIGHEST for action port [ 588.183365] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.186561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.186650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.186865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.186997] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.188632] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.188632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.188776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d32aea38-4b8b-44ab-a80e-62bdad775bd5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.188875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.188937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.189837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.189837] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d32aea38-4b8b-44ab-a80e-62bdad775bd5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.497410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 588.497726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.692761] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.692947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.696953] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d32aea38-4b8b-44ab-a80e-62bdad775bd5 with status ACTIVE [ 588.697193] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.697324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.697396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.697611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.697705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.697891] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.697995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.698072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.698223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.698301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.698478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.698593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.698642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.698770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.698845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.698930] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d32aea38-4b8b-44ab-a80e-62bdad775bd5 is going to be updated. [ 588.721615] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.721755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.721826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.722052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.722222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.722360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d32aea38-4b8b-44ab-a80e-62bdad775bd5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.679135] env[64436]: INFO networking_nsxv3.common.synchronization [req-4e900894-5a92-4406-8bef-dfdc214caa47 req-05191a0f-5192-48ca-8fe1-d6afa4e57d04 tempest-AttachInterfacesV270Test-706040131 tempest-AttachInterfacesV270Test-706040131-project-member] Enqueued Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_members [ 589.679684] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_members [ 589.679982] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.680718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.680985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.681629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.682029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.682113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.682291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.682590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.682869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.682962] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.890028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 589.890028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.890028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.890028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.890028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.890028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.890028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.890028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.890028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.890028] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.063927] env[64436]: INFO networking_nsxv3.common.synchronization [None req-960d4b74-8abe-4b87-ace2-6760b01b960b None None] Enqueued Resource ID: f8204074-6d73-423d-a650-f3e98310103e with Priority: HIGHEST for action port [ 590.064859] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8204074-6d73-423d-a650-f3e98310103e with Priority: HIGHEST for action port [ 590.065893] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8204074-6d73-423d-a650-f3e98310103e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.066185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8204074-6d73-423d-a650-f3e98310103e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.066307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8204074-6d73-423d-a650-f3e98310103e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.066744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8204074-6d73-423d-a650-f3e98310103e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.066938] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8204074-6d73-423d-a650-f3e98310103e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.188035] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.188206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.188281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.188519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.188616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.191332] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.191494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.191566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.193643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.193804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.195144] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0c7f357-fb7f-4089-8ca6-73477491c51b already deleted. [ 590.195144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.393903] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.426249] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.426515] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-643" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.426720] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-643" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.427186] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-643" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.427576] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.427854] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.428042] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.428358] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.428571] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.428848] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.429027] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.429196] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.429368] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.429566] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.429676] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.429851] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.450585] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.451400] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 590.451400] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.451400] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-643" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.451860] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-2090379a-f85b-446f-83a6-a0d74703563a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.452533] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.452753] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.453431] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.453717] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2090379a-f85b-446f-83a6-a0d74703563a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.570423] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8204074-6d73-423d-a650-f3e98310103e [ 590.571067] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.571067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.571067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.571334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.571680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.571680] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8204074-6d73-423d-a650-f3e98310103e already deleted. [ 590.571680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8204074-6d73-423d-a650-f3e98310103e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.755475] env[64436]: INFO networking_nsxv3.common.synchronization [req-3492330e-a509-4cda-961e-da3db80db672 req-a4b61aa2-ab78-40a5-86c0-241dc7441a5b tempest-SecurityGroupRulesTestJSON-1458343354 tempest-SecurityGroupRulesTestJSON-1458343354-project-member] Enqueued Resource ID: 3579fffd-b0e5-4add-bcf1-d64427b05abb with Priority: HIGHEST for action security_group_rules [ 590.755882] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3579fffd-b0e5-4add-bcf1-d64427b05abb with Priority: HIGHEST for action security_group_rules [ 590.756804] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3579fffd-b0e5-4add-bcf1-d64427b05abb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.757321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3579fffd-b0e5-4add-bcf1-d64427b05abb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.757321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3579fffd-b0e5-4add-bcf1-d64427b05abb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.757426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3579fffd-b0e5-4add-bcf1-d64427b05abb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.757495] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3579fffd-b0e5-4add-bcf1-d64427b05abb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.897497] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.957761] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.960756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.960756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.960756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.960756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.960756] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 2090379a-f85b-446f-83a6-a0d74703563a not found, creating... [ 590.960756] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.960756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.961344] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.961393] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.961610] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.961915] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.962498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.962498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.962498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.963298] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.963432] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 2090379a-f85b-446f-83a6-a0d74703563a is going to be created. [ 590.991875] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.992136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.992287] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.992542] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.992800] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.993077] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.278355] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.278713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.278797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.279235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.279363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.280121] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3579fffd-b0e5-4add-bcf1-d64427b05abb already deleted. [ 591.280121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3579fffd-b0e5-4add-bcf1-d64427b05abb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.400049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.400292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.400392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.400671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.400835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.401612] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 591.432284] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.432284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.432284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.432469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.432613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.441258] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 591.753404] env[64436]: INFO networking_nsxv3.common.synchronization [None req-2c903205-ab8e-4337-93b1-f3e1354cf87a None None] Enqueued Resource ID: a36a5109-a934-4e03-a587-7daa2b5645d7 with Priority: HIGHEST for action port [ 591.753404] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36a5109-a934-4e03-a587-7daa2b5645d7 with Priority: HIGHEST for action port [ 591.754049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36a5109-a934-4e03-a587-7daa2b5645d7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.754049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36a5109-a934-4e03-a587-7daa2b5645d7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.754049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36a5109-a934-4e03-a587-7daa2b5645d7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.754218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36a5109-a934-4e03-a587-7daa2b5645d7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.755762] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36a5109-a934-4e03-a587-7daa2b5645d7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.204915] env[64436]: INFO networking_nsxv3.common.synchronization [None req-8fd79a11-ece1-4f30-96d5-04f451d24950 None None] Enqueued Resource ID: 712faf79-64be-4a52-965e-8809f89f21ca with Priority: HIGHEST for action port [ 592.205231] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 712faf79-64be-4a52-965e-8809f89f21ca with Priority: HIGHEST for action port [ 592.205757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-712faf79-64be-4a52-965e-8809f89f21ca taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.205993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-712faf79-64be-4a52-965e-8809f89f21ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.206062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-712faf79-64be-4a52-965e-8809f89f21ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.206276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-712faf79-64be-4a52-965e-8809f89f21ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.206357] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('712faf79-64be-4a52-965e-8809f89f21ca',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.257392] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a36a5109-a934-4e03-a587-7daa2b5645d7 [ 592.258276] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.258428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.258509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.258741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.258848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.258957] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a36a5109-a934-4e03-a587-7daa2b5645d7 already deleted. [ 592.259062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36a5109-a934-4e03-a587-7daa2b5645d7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.558550] env[64436]: INFO networking_nsxv3.common.synchronization [req-4511c8d7-d111-4850-8039-f8c5f7926fa0 req-f917f515-e646-46d5-9789-8efa1e338c35 tempest-ServerAddressesTestJSON-1586530565 tempest-ServerAddressesTestJSON-1586530565-project-member] Enqueued Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_members [ 592.559199] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac with Priority: HIGHEST for action security_group_members [ 592.559557] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b915a177-2742-49be-9ca9-2dc30ee9c6ac taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.559689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.559851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.559978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.564659] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.565653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.567630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.567630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.567630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.567630] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b915a177-2742-49be-9ca9-2dc30ee9c6ac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.684138] env[64436]: INFO networking_nsxv3.common.synchronization [req-e869c85e-4d44-4cad-9785-492a8d38bb04 req-2541bc4a-764f-44ca-ab04-485abc8ef438 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 592.684416] env[64436]: INFO networking_nsxv3.common.synchronization [req-e869c85e-4d44-4cad-9785-492a8d38bb04 req-2541bc4a-764f-44ca-ab04-485abc8ef438 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 592.685710] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 592.685862] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 592.686768] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.687028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.688243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.688243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.688243] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.688243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.688243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.688243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.688243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.688673] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.689581] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.689679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.689719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.689867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.690024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.690511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.690511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.690511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.690511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.690511] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.709159] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 712faf79-64be-4a52-965e-8809f89f21ca [ 592.709159] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.709159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.709159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.709379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.709379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.709456] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:712faf79-64be-4a52-965e-8809f89f21ca already deleted. [ 592.709535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-712faf79-64be-4a52-965e-8809f89f21ca" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.753588] env[64436]: INFO networking_nsxv3.common.synchronization [req-4e900894-5a92-4406-8bef-dfdc214caa47 req-62769b5e-ef5f-4594-9da7-aa938d9f5958 service nova] Enqueued Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_rules [ 592.753588] env[64436]: INFO networking_nsxv3.common.synchronization [req-4e900894-5a92-4406-8bef-dfdc214caa47 req-62769b5e-ef5f-4594-9da7-aa938d9f5958 service nova] Enqueued Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_members [ 592.753588] env[64436]: INFO networking_nsxv3.common.synchronization [req-4e900894-5a92-4406-8bef-dfdc214caa47 req-62769b5e-ef5f-4594-9da7-aa938d9f5958 service nova] Enqueued Resource ID: 2090379a-f85b-446f-83a6-a0d74703563a with Priority: HIGHEST for action port [ 592.753588] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_rules [ 592.753588] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_members [ 592.753588] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2090379a-f85b-446f-83a6-a0d74703563a with Priority: HIGHEST for action port [ 592.753901] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.753901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.754066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.754726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.754726] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.755655] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.755838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.756121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.758952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.758952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.759437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.759437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.759437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.759536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.759730] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.763811] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2090379a-f85b-446f-83a6-a0d74703563a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.763811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.763811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.763811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.763811] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2090379a-f85b-446f-83a6-a0d74703563a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.853414] env[64436]: INFO networking_nsxv3.common.synchronization [req-e869c85e-4d44-4cad-9785-492a8d38bb04 req-2541bc4a-764f-44ca-ab04-485abc8ef438 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_rules [ 592.853992] env[64436]: INFO networking_nsxv3.common.synchronization [req-e869c85e-4d44-4cad-9785-492a8d38bb04 req-2541bc4a-764f-44ca-ab04-485abc8ef438 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 592.854364] env[64436]: INFO networking_nsxv3.common.synchronization [req-e869c85e-4d44-4cad-9785-492a8d38bb04 req-2541bc4a-764f-44ca-ab04-485abc8ef438 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 592.854762] env[64436]: INFO networking_nsxv3.common.synchronization [req-e869c85e-4d44-4cad-9785-492a8d38bb04 req-2541bc4a-764f-44ca-ab04-485abc8ef438 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 592.855783] env[64436]: INFO networking_nsxv3.common.synchronization [req-e869c85e-4d44-4cad-9785-492a8d38bb04 req-2541bc4a-764f-44ca-ab04-485abc8ef438 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 0496d996-77fe-4a95-8f55-282de9be2311 with Priority: HIGHEST for action port [ 592.857050] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_rules [ 592.858103] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 592.858103] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0496d996-77fe-4a95-8f55-282de9be2311 with Priority: HIGHEST for action port [ 592.858103] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 592.858103] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 592.858103] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.858398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.858434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.858896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.858896] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.860151] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.860349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.860429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.860693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.860797] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.861722] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-0496d996-77fe-4a95-8f55-282de9be2311 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.861840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.861958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.862168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.862273] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0496d996-77fe-4a95-8f55-282de9be2311',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.863496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.863496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.864577] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.864577] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.072038] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.072287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.072365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.073596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.077024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.077024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.077024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.077024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.077024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.077024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.077024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac is going to be updated. [ 593.115092] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.115092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.115092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.115092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.115092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.123553] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac in Status: IN_PROGRESS for 2s [ 593.193024] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.194356] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.263670] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.263861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.263939] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2090379a-f85b-446f-83a6-a0d74703563a with status ACTIVE [ 593.264125] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.264380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.264380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.266364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.266364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.266364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.266364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.266677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.266677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.266958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.267028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.267164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.267249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.267431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.267534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.268173] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2090379a-f85b-446f-83a6-a0d74703563a is going to be updated. [ 593.269186] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.293428] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.297206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.297349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.297584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.297731] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.297908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2090379a-f85b-446f-83a6-a0d74703563a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.364340] env[64436]: INFO networking_nsxv3.common.synchronization [None req-354395af-cee2-49e6-b375-be3a64d21556 None None] Enqueued Resource ID: 79f761e5-ba58-493b-8169-10c439ed9f08 with Priority: HIGHEST for action port [ 593.364340] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79f761e5-ba58-493b-8169-10c439ed9f08 with Priority: HIGHEST for action port [ 593.364340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-79f761e5-ba58-493b-8169-10c439ed9f08 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.364340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79f761e5-ba58-493b-8169-10c439ed9f08" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.364340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79f761e5-ba58-493b-8169-10c439ed9f08" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.364340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79f761e5-ba58-493b-8169-10c439ed9f08" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.364340] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f761e5-ba58-493b-8169-10c439ed9f08',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.365134] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.365247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.365538] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0496d996-77fe-4a95-8f55-282de9be2311 with status ACTIVE [ 593.365872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.366252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.366497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.366633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.366925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.367071] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.367246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.367321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.367521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.367644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.367878] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.369333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.369333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.369333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.369333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.369333] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0496d996-77fe-4a95-8f55-282de9be2311 is going to be updated. [ 593.369858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.370108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.394845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.395528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.395528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.395528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.395528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.395722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.452252] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 593.453220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.453451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.453716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.453983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.454248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.454248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.454499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.454669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.454804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.454954] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.696158] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.697254] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.772383] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.871636] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79f761e5-ba58-493b-8169-10c439ed9f08 [ 593.873472] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.873472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.873472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.873472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.873472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.873472] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79f761e5-ba58-493b-8169-10c439ed9f08 already deleted. [ 593.873472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79f761e5-ba58-493b-8169-10c439ed9f08" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.959609] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.959886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.959955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.960165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.960370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.960446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.960510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.960659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.960782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.960876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.961381] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.961461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.961521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.961860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.961956] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.963116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.963324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.965518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.965518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.965518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.965518] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.199446] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.199785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.199785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.201820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.201820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.201820] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be created. [ 594.202064] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.202200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.202330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.203420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.203518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.203551] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 594.230351] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.230351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.230351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.230351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.230351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.237255] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.237255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.237255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.237255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.237255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.243652] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 594.244437] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: UNINITIALIZED for 2s [ 594.278752] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.278752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.278752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.278752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.278752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.278752] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0c7f357-fb7f-4089-8ca6-73477491c51b is going to be created. [ 594.304453] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.304626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.304672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.304922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.305066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.316915] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0c7f357-fb7f-4089-8ca6-73477491c51b in Status: UNINITIALIZED for 2s [ 594.319096] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f0703ab8-d0b2-48ec-8d44-c1f4ce1dd33e None None] Enqueued Resource ID: ec4a977b-c02c-432f-854c-d27504b2200d with Priority: HIGHEST for action port [ 594.321226] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4a977b-c02c-432f-854c-d27504b2200d with Priority: HIGHEST for action port [ 594.321226] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec4a977b-c02c-432f-854c-d27504b2200d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.321226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec4a977b-c02c-432f-854c-d27504b2200d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.321226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec4a977b-c02c-432f-854c-d27504b2200d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.321505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec4a977b-c02c-432f-854c-d27504b2200d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.321505] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec4a977b-c02c-432f-854c-d27504b2200d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.326137] env[64436]: INFO networking_nsxv3.common.synchronization [req-19466a0a-5885-44dd-a96d-80f5dfa5a960 req-688f999b-699b-40fa-b747-8fa476b974d0 tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 594.326608] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 594.327266] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.327266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.327266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.327519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.327561] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.328220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.328220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.328220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.328220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.328220] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.469256] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeeb0085-3d91-4859-b6e8-d553406b2219: rpc.has_security_group_logging(os_id): False [ 594.490550] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.490845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.490953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.491210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.491338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.491579] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.491681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.491747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.491916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.492019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.495787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.495787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.495787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.500589] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 594.560554] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_members [ 594.560614] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 594.561016] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 594.561512] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_members [ 594.561660] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 594.561762] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 594.562093] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-73a0cec9-fcd4-4729-abd7-b50d1439753c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.562230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.562292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.562551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.562712] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.562811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.562872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.563113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.563113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.563213] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.564324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.564324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.564324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.564530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.566818] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.566818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.566818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.566818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.567032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.586532] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 594.681458] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_rules [ 594.681661] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 594.681809] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_rules [ 594.681992] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_members [ 594.682099] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 594.682242] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 594.682426] env[64436]: INFO networking_nsxv3.common.synchronization [req-16373fa5-5e8d-4c69-9df7-1a5de813d33b req-8f95f803-05b0-46ea-9f3d-4dc194b0f611 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 0496d996-77fe-4a95-8f55-282de9be2311 with Priority: HIGHEST for action port [ 594.682885] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_rules [ 594.683856] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_rules [ 594.683856] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 594.684074] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0496d996-77fe-4a95-8f55-282de9be2311 with Priority: HIGHEST for action port [ 594.684113] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 594.684332] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 594.684332] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_members [ 594.684877] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.684877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.685042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73a0cec9-fcd4-4729-abd7-b50d1439753c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.685042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.685155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.685320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.685660] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.686845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.686845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.687895] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-0496d996-77fe-4a95-8f55-282de9be2311 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.687895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.687895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.692538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.692538] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0496d996-77fe-4a95-8f55-282de9be2311',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.694166] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.694166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.694166] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.694166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.694166] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-73a0cec9-fcd4-4729-abd7-b50d1439753c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.694166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.824406] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec4a977b-c02c-432f-854c-d27504b2200d [ 594.824753] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.827148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.827148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.827148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.827148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.827148] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec4a977b-c02c-432f-854c-d27504b2200d already deleted. [ 594.827148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec4a977b-c02c-432f-854c-d27504b2200d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.831803] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.831803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.831803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.832031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.832097] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.832296] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.833580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.833580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.833580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.833580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.833580] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d already deleted. [ 594.833580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.066055] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.138841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac in Status: SUCCESS [ 595.143270] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b915a177-2742-49be-9ca9-2dc30ee9c6ac deletion is rescheduled due to dependency. [ 595.143404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b915a177-2742-49be-9ca9-2dc30ee9c6ac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.195598] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0496d996-77fe-4a95-8f55-282de9be2311 with status ACTIVE [ 595.195598] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.195994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.195994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.196716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.196798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.197065] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.197174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.197262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.197446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.197551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.198162] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.198162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.198162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.198362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.198362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.198438] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0496d996-77fe-4a95-8f55-282de9be2311 is going to be updated. [ 595.199832] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-73a0cec9-fcd4-4729-abd7-b50d1439753c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.199971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.218585] env[64436]: INFO networking_nsxv3.common.synchronization [None req-e78d8706-7288-47e8-a0a7-c3600ce68634 tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 595.219093] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 595.219972] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.220058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.220271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.220370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.220452] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.225021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.225021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.225021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.225021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.225021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.225021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0496d996-77fe-4a95-8f55-282de9be2311" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.272577] env[64436]: INFO networking_nsxv3.common.synchronization [req-7faa0cb5-efa9-486a-8aa9-f4ccaf9f92c3 req-27b438bd-3b4f-44af-9054-c34438465798 tempest-SecurityGroupRulesTestJSON-1458343354 tempest-SecurityGroupRulesTestJSON-1458343354-project-member] Enqueued Resource ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d with Priority: HIGHEST for action security_group_rules [ 595.272577] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d with Priority: HIGHEST for action security_group_rules [ 595.273111] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-042cb145-7684-41fc-a4fb-0af90ce97b9d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.274488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.274488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.274488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.274488] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('042cb145-7684-41fc-a4fb-0af90ce97b9d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.340271] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.340580] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.340793] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.342784] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.342784] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.342784] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.343665] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.344100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.344356] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.344566] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.344718] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.345135] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.345334] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.345502] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.345688] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.345905] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.370374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.370374] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 595.370470] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.370702] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.370943] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b094d056-8fa9-4280-a019-ac6dc777b089 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.371138] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.371304] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.371573] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.371706] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b094d056-8fa9-4280-a019-ac6dc777b089',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.472693] env[64436]: INFO networking_nsxv3.common.synchronization [None req-9e0d5d20-d87b-4327-97e2-036f3824203b tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 595.473683] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 595.473683] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.473856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.567834] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.740274] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.740470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.740470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.740694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.740786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.740882] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 already deleted. [ 595.740998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.741422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.741621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.741709] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.792388] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.792540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.792594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.792825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.792918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.793022] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d already deleted. [ 595.793110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.872632] env[64436]: INFO networking_nsxv3.common.synchronization [None req-a1466203-ff53-4d95-9e16-b327208b9464 None None] Enqueued Resource ID: 7662f217-4e6b-4619-b4e1-ff458d68447f with Priority: HIGHEST for action port [ 595.873059] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7662f217-4e6b-4619-b4e1-ff458d68447f with Priority: HIGHEST for action port [ 595.873365] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-7662f217-4e6b-4619-b4e1-ff458d68447f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.873571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7662f217-4e6b-4619-b4e1-ff458d68447f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.873571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7662f217-4e6b-4619-b4e1-ff458d68447f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.873888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7662f217-4e6b-4619-b4e1-ff458d68447f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.873970] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7662f217-4e6b-4619-b4e1-ff458d68447f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.876718] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.876982] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.881140] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.881452] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.881612] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.881772] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b094d056-8fa9-4280-a019-ac6dc777b089 not found, creating... [ 595.882066] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.882245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.882366] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.882650] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.882724] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.883015] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.886276] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.886410] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.886638] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.886779] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.886944] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b094d056-8fa9-4280-a019-ac6dc777b089 is going to be created. [ 595.920880] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.921115] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.921284] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.921579] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.921896] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.922164] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.071507] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.071683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.071758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.071973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.072164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.072277] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c is going to be created. [ 596.099171] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.099352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.099400] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.099656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.099855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.116253] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: UNINITIALIZED for 2s [ 596.258878] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 596.260236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.260473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.260727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.261246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.261452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.261652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.262065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.262183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.262882] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.265595] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: SUCCESS [ 596.265595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.265595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.265947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.265947] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.266054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.266265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.266334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.266372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.266462] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.268617] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.268723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.268793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.268951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.269042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.269198] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 already deleted. [ 596.269290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.325303] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0c7f357-fb7f-4089-8ca6-73477491c51b in Status: SUCCESS [ 596.325593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.325791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.326117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.326557] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.326720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.326815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.327059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.327329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.327329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.327435] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.389976] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7662f217-4e6b-4619-b4e1-ff458d68447f [ 596.391687] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.391687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.392080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.392376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.392473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.392581] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7662f217-4e6b-4619-b4e1-ff458d68447f already deleted. [ 596.392672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7662f217-4e6b-4619-b4e1-ff458d68447f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.510404] env[64436]: INFO networking_nsxv3.common.synchronization [None req-3a5d0637-a25b-4eb5-8009-00c0b3b8475b None None] Enqueued Resource ID: 26447dbe-1f1a-4fac-96db-93e1473685e3 with Priority: HIGHEST for action port [ 596.510404] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26447dbe-1f1a-4fac-96db-93e1473685e3 with Priority: HIGHEST for action port [ 596.510526] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-26447dbe-1f1a-4fac-96db-93e1473685e3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.510642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26447dbe-1f1a-4fac-96db-93e1473685e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.510723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26447dbe-1f1a-4fac-96db-93e1473685e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.510996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26447dbe-1f1a-4fac-96db-93e1473685e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.513061] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26447dbe-1f1a-4fac-96db-93e1473685e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.605492] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 596.605492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.770399] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.771353] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.830126] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.830343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.830343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.832290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.832290] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.832290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.832290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.832290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.832290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.832290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.832952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.832952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.832952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.832952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.833106] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.833106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.833181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.833283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.833362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.833442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.833529] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.849178] env[64436]: INFO networking_nsxv3.common.synchronization [req-aceff7ff-a26f-44e3-975d-89477bf77bc6 req-19747a87-5bff-4519-8bf6-88d81e40ecab tempest-FloatingIPsAssociationTestJSON-1278161632 tempest-FloatingIPsAssociationTestJSON-1278161632-project-member] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 596.849681] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 596.852113] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.852113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.852113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.852113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.852113] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.852113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.852113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.852113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.852113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.852113] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.021810] env[64436]: INFO networking_nsxv3.common.synchronization [req-3853b1c9-cfe9-4cb7-ac46-dd03ea3758b2 req-5c6f3997-ab42-4255-aa64-d091c5449013 tempest-SecurityGroupRulesTestJSON-1458343354 tempest-SecurityGroupRulesTestJSON-1458343354-project-member] Enqueued Resource ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d with Priority: HIGHEST for action security_group_rules [ 597.023055] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26447dbe-1f1a-4fac-96db-93e1473685e3 [ 597.023055] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.023229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.023515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.023784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.023939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.024652] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26447dbe-1f1a-4fac-96db-93e1473685e3 already deleted. [ 597.024812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26447dbe-1f1a-4fac-96db-93e1473685e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.025027] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d with Priority: HIGHEST for action security_group_rules [ 597.025633] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-042cb145-7684-41fc-a4fb-0af90ce97b9d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.025887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.026285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.026531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.026660] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('042cb145-7684-41fc-a4fb-0af90ce97b9d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.273592] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.275299] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.337893] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0c7f357-fb7f-4089-8ca6-73477491c51b: rpc.has_security_group_logging(os_id): False [ 597.352946] env[64436]: INFO networking_nsxv3.common.synchronization [req-19466a0a-5885-44dd-a96d-80f5dfa5a960 req-34346abd-72d1-4791-978b-65d848acfdee service nova] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 597.353135] env[64436]: INFO networking_nsxv3.common.synchronization [req-19466a0a-5885-44dd-a96d-80f5dfa5a960 req-34346abd-72d1-4791-978b-65d848acfdee service nova] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 597.353271] env[64436]: INFO networking_nsxv3.common.synchronization [req-19466a0a-5885-44dd-a96d-80f5dfa5a960 req-34346abd-72d1-4791-978b-65d848acfdee service nova] Enqueued Resource ID: b094d056-8fa9-4280-a019-ac6dc777b089 with Priority: HIGHEST for action port [ 597.355174] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 597.355334] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 597.355436] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094d056-8fa9-4280-a019-ac6dc777b089 with Priority: HIGHEST for action port [ 597.356574] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.356704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.356800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.357104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.357303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.357416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.357534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.357809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.357809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.357900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.358483] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.358483] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.358483] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.358654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.358692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.358875] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.358985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.359060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.359204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.359275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.359354] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0c7f357-fb7f-4089-8ca6-73477491c51b is going to be created. [ 597.361250] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.361787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.362315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.362315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.362315] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.364998] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.368445] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.368445] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.368445] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.368445] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b094d056-8fa9-4280-a019-ac6dc777b089 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.368445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.369147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.369147] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b094d056-8fa9-4280-a019-ac6dc777b089',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.424724] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.424914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.424971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.425238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.425349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.437841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0c7f357-fb7f-4089-8ca6-73477491c51b in Status: IN_PROGRESS for 2s [ 597.549267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.549429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.549493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.549898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.549898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.549898] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d already deleted. [ 597.550074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.776688] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.776688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.776688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.776688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.776688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.776688] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 597.778046] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.778194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.778255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.778404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.778487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.778578] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be updated. [ 597.810535] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.810535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.810535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.810535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.810535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.811514] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.811514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.811862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.811862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.811956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.821082] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: IN_PROGRESS for 2s [ 597.821725] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 597.866385] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.866601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.866747] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.872230] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.873055] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b094d056-8fa9-4280-a019-ac6dc777b089 with status ACTIVE [ 597.877921] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.877921] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.877921] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.877921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.877921] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b094d056-8fa9-4280-a019-ac6dc777b089 is going to be updated. [ 597.897472] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.897634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.897724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.897914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.898068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.898231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.037186] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.037588] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.037662] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.037999] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.038339] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.038628] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.038759] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.038991] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.039265] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.039945] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.040128] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.040310] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.040463] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.040612] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.040800] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.040972] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.061254] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.061506] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 598.061690] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.061916] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-472" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.062196] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.062372] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.062505] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.062829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.062973] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.128300] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: UNINITIALIZED for 4s [ 598.370485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.370696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.370747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.370993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.371116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.371223] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be updated. [ 598.380435] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.399364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.399364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.399364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.399364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.399742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.410317] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: IN_PROGRESS for 2s [ 598.425997] env[64436]: INFO networking_nsxv3.common.synchronization [None req-3e94ebe2-37aa-45d7-8552-13aab33d12cc None None] Enqueued Resource ID: 5b005e9d-64e4-4537-93bc-ba46a123d280 with Priority: HIGHEST for action port [ 598.426263] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b005e9d-64e4-4537-93bc-ba46a123d280 with Priority: HIGHEST for action port [ 598.426925] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b005e9d-64e4-4537-93bc-ba46a123d280 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.427069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b005e9d-64e4-4537-93bc-ba46a123d280" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.427069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b005e9d-64e4-4537-93bc-ba46a123d280" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.428263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b005e9d-64e4-4537-93bc-ba46a123d280" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.428369] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b005e9d-64e4-4537-93bc-ba46a123d280',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.565859] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.566168] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.566308] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.567347] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.567419] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.567557] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 not found, creating... [ 598.567853] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.568059] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.568194] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.569771] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.570042] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.571456] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.571725] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.571725] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.571917] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.572090] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.572336] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 is going to be created. [ 598.579609] env[64436]: INFO networking_nsxv3.common.synchronization [None req-51b31a0f-251f-4226-a266-cacce0100524 None None] Enqueued Resource ID: f118c30f-d07b-4a10-88f9-2b0fcbd73f15 with Priority: HIGHEST for action port [ 598.580614] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f118c30f-d07b-4a10-88f9-2b0fcbd73f15 with Priority: HIGHEST for action port [ 598.580935] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-f118c30f-d07b-4a10-88f9-2b0fcbd73f15 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.581211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f118c30f-d07b-4a10-88f9-2b0fcbd73f15" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.581294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f118c30f-d07b-4a10-88f9-2b0fcbd73f15" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.581670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f118c30f-d07b-4a10-88f9-2b0fcbd73f15" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.582532] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f118c30f-d07b-4a10-88f9-2b0fcbd73f15',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.599489] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.599489] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.599489] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.599489] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.599489] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.599489] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.883749] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.884077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.884158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.884381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.884469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.884566] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d is going to be created. [ 598.907985] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.908273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.908393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.908682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.908888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.923050] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: UNINITIALIZED for 2s [ 598.932533] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b005e9d-64e4-4537-93bc-ba46a123d280 [ 598.933266] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.933444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.933538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.933787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.933925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.934057] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b005e9d-64e4-4537-93bc-ba46a123d280 already deleted. [ 598.934347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b005e9d-64e4-4537-93bc-ba46a123d280" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.086451] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f118c30f-d07b-4a10-88f9-2b0fcbd73f15 [ 599.087399] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.087715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.087956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.088274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.088465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.088639] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f118c30f-d07b-4a10-88f9-2b0fcbd73f15 already deleted. [ 599.088805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f118c30f-d07b-4a10-88f9-2b0fcbd73f15" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.327565] env[64436]: INFO networking_nsxv3.common.synchronization [req-044f999f-e9b0-4e52-9481-90f7f26a30f0 req-26783591-d843-4d5e-a2c3-1433df50bb20 tempest-ServersNegativeTestMultiTenantJSON-694526049 tempest-ServersNegativeTestMultiTenantJSON-694526049-project-member] Enqueued Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_members [ 599.327892] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_members [ 599.328211] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.328333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.328393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.328680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.328839] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.328951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.329022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.329177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.329260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.329348] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.451142] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0c7f357-fb7f-4089-8ca6-73477491c51b in Status: SUCCESS [ 599.451427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.832813] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 599.832813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.833068] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: SUCCESS [ 599.833195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.833343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.833581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.833769] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.833893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.833958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.834144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.834213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.834308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.834403] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.837280] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.837462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.837533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.838270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.838270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.838270] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.838270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.838270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.838540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.838540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.838618] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 already deleted. [ 599.838692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.838816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.839015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.839176] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.839272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.839333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.839516] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.842894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.844608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.844608] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.844608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.844608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.844608] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.844608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.844608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.844996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.844996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.844996] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.845710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.845930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.846125] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.846277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.846354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.846624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.846624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.846724] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.901275] env[64436]: INFO networking_nsxv3.common.synchronization [None req-223b4a1c-74bb-4a0e-9693-179a8c7ff99e None None] Enqueued Resource ID: 1486916e-7660-495b-bcd3-59cc76c75c6a with Priority: HIGHEST for action port [ 599.901870] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1486916e-7660-495b-bcd3-59cc76c75c6a with Priority: HIGHEST for action port [ 599.902538] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1486916e-7660-495b-bcd3-59cc76c75c6a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.902742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1486916e-7660-495b-bcd3-59cc76c75c6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.902871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1486916e-7660-495b-bcd3-59cc76c75c6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.903338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1486916e-7660-495b-bcd3-59cc76c75c6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.903471] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1486916e-7660-495b-bcd3-59cc76c75c6a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.927685] env[64436]: INFO networking_nsxv3.common.synchronization [req-b4f81d02-7dae-44e8-8504-7c8a633f91e5 req-6b9cf882-ad33-470e-be37-6d09768df8c2 tempest-SecurityGroupRulesTestJSON-1458343354 tempest-SecurityGroupRulesTestJSON-1458343354-project-member] Enqueued Resource ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d with Priority: HIGHEST for action security_group_rules [ 599.927685] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d with Priority: HIGHEST for action security_group_rules [ 599.927979] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-042cb145-7684-41fc-a4fb-0af90ce97b9d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.928177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.928177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.928382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.928462] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('042cb145-7684-41fc-a4fb-0af90ce97b9d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.142019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: SUCCESS [ 600.142019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.142019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.142019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.142019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.142019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.142019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.142019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.142019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.142019] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.212316] env[64436]: INFO networking_nsxv3.common.synchronization [req-aceff7ff-a26f-44e3-975d-89477bf77bc6 req-f7b9882e-25e2-445e-af4e-15343e225b2b service nova] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_rules [ 600.212649] env[64436]: INFO networking_nsxv3.common.synchronization [req-aceff7ff-a26f-44e3-975d-89477bf77bc6 req-f7b9882e-25e2-445e-af4e-15343e225b2b service nova] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 600.212896] env[64436]: INFO networking_nsxv3.common.synchronization [req-aceff7ff-a26f-44e3-975d-89477bf77bc6 req-f7b9882e-25e2-445e-af4e-15343e225b2b service nova] Enqueued Resource ID: 98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 with Priority: HIGHEST for action port [ 600.213509] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_rules [ 600.213960] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 600.214261] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 with Priority: HIGHEST for action port [ 600.214899] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.215348] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.215548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.215957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.216998] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.217102] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.217211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.217428] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.217532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.217603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.217794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.217880] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.339746] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.339746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.348935] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.349824] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.352030] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.383705] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.383977] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-317" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.384189] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-317" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.384467] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-317" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.387205] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.387410] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.387533] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.387809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.388137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.388246] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.388304] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.388394] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.388502] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.389206] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.389206] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.389206] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.406541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1486916e-7660-495b-bcd3-59cc76c75c6a [ 600.406541] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.406720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.406720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.406942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.407082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.407182] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1486916e-7660-495b-bcd3-59cc76c75c6a already deleted. [ 600.407267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1486916e-7660-495b-bcd3-59cc76c75c6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.408347] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.408529] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 600.408646] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.408811] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-317" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.410706] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.411285] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.411285] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.411604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.411748] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.427079] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: SUCCESS [ 600.427079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.427079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.427079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.427311] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.427311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.427311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.427484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.427542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.427636] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.449260] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.449260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.449370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.450132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.450132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.450132] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 042cb145-7684-41fc-a4fb-0af90ce97b9d already deleted. [ 600.450132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-042cb145-7684-41fc-a4fb-0af90ce97b9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.645555] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.719839] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.719915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.720159] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 with status ACTIVE [ 600.720287] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.720466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.720466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.720746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.720746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.721025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.721025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.721179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.721217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.722026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.722026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.722026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.722026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.722433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.722433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.722433] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7 is going to be updated. [ 600.744467] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.744467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.744467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.744467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.744467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.744467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98cdfaa9-a6e0-4db5-a4a9-7836088ba5a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.852720] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.854544] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c2d8d81-8cc8-44df-9d77-63cb789204d8: rpc.has_security_group_logging(os_id): False [ 600.859546] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.878854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.880533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.880533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.880533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.880533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.880533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.880533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.880843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.881694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.884131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.884244] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be created. [ 600.919993] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.920196] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.920327] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.920626] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.920778] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.920941] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e not found, creating... [ 600.923027] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.923027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.923027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.923027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.923027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.923027] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.923027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.923027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.923027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.923449] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.923449] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e is going to be created. [ 600.930523] env[64436]: INFO networking_nsxv3.common.synchronization [req-3e74c161-38db-4981-ab42-b9a35f2ca4ed req-d9bc38b0-660e-4b01-98ce-c2fa3c10e348 tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 600.931527] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 600.931783] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.932962] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.933103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.933172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.933870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.934169] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.934169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.934258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.934408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.934494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.934624] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.936259] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.936747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.936747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.936747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.936747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.949666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: SUCCESS [ 600.949917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.952511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.952511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.952511] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.952511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.952511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.952511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.952511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.952511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.952511] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.953364] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: IN_PROGRESS for 2s [ 600.965666] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.965987] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.966232] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.969442] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.969748] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.970038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.973371] env[64436]: INFO networking_nsxv3.common.synchronization [None req-3c19c254-1143-4b56-84df-de13e38c6fcc None None] Enqueued Resource ID: 5764e8da-16d3-47ff-82ec-77f6b20f38f8 with Priority: HIGHEST for action port [ 600.974171] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5764e8da-16d3-47ff-82ec-77f6b20f38f8 with Priority: HIGHEST for action port [ 600.974470] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5764e8da-16d3-47ff-82ec-77f6b20f38f8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.974591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5764e8da-16d3-47ff-82ec-77f6b20f38f8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.974696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5764e8da-16d3-47ff-82ec-77f6b20f38f8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.974903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5764e8da-16d3-47ff-82ec-77f6b20f38f8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.974989] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5764e8da-16d3-47ff-82ec-77f6b20f38f8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.152196] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.361285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.362137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.362137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.362137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.362137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.362137] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 601.364483] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.364483] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.366442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.367525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.367525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.367679] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be updated. [ 601.391053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.391053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.391053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.391053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.391053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.393173] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.393173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.393173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.393645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.393726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.403362] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 601.404172] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: IN_PROGRESS for 2s [ 601.439406] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.440157] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.440296] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.440361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.440563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.440658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.440849] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.440955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.441032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.441186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.441265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.441350] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be updated. [ 601.454654] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.463061] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ff5232c9-312b-48ae-af26-cde6c2ead2ec None None] Enqueued Resource ID: 0283d27c-227f-4004-b2dc-ad8f43c940b4 with Priority: HIGHEST for action port [ 601.463254] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0283d27c-227f-4004-b2dc-ad8f43c940b4 with Priority: HIGHEST for action port [ 601.464092] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-0283d27c-227f-4004-b2dc-ad8f43c940b4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.464092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0283d27c-227f-4004-b2dc-ad8f43c940b4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.464092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0283d27c-227f-4004-b2dc-ad8f43c940b4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.464258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0283d27c-227f-4004-b2dc-ad8f43c940b4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.464295] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0283d27c-227f-4004-b2dc-ad8f43c940b4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.470309] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.470309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.470309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.470309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.470664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.476417] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5764e8da-16d3-47ff-82ec-77f6b20f38f8 [ 601.476621] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.476722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.476787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.477089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.477176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.477266] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5764e8da-16d3-47ff-82ec-77f6b20f38f8 already deleted. [ 601.477345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5764e8da-16d3-47ff-82ec-77f6b20f38f8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.479097] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 601.631927] env[64436]: INFO networking_nsxv3.common.synchronization [None req-fff4ab37-4429-401a-ba15-cfb26edf69a3 tempest-ServersTestBootFromVolume-1864235061 tempest-ServersTestBootFromVolume-1864235061-project-member] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_rules [ 601.632816] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_rules [ 601.633269] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.633522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.633674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.634374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.634538] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.655510] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.655716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.655816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.656124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.656249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.656379] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c is going to be updated. [ 601.680866] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.681053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.681129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.681343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.681501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.690061] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: IN_PROGRESS for 2s [ 601.945398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.945561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.945631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.945843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.945951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.946064] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be updated. [ 601.957582] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfb4c1c6-2021-458b-840f-cd83ee502c3d: rpc.has_security_group_logging(os_id): False [ 601.965921] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b8893108-b79b-483a-9b2d-7135c9c7c1cf tempest-ServersTestBootFromVolume-1864235061 tempest-ServersTestBootFromVolume-1864235061-project-member] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_rules [ 601.966470] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_rules [ 601.966693] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0283d27c-227f-4004-b2dc-ad8f43c940b4 [ 601.966906] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.969346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.969655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.969655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.969771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.969857] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0283d27c-227f-4004-b2dc-ad8f43c940b4 already deleted. [ 601.969942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0283d27c-227f-4004-b2dc-ad8f43c940b4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.970297] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.970406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.975148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.975148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.975148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.975148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.975148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.975148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.975470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.975470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.975470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.975574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.975610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d is going to be created. [ 601.978639] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.978748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.978812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.978965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.979329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.987375] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: IN_PROGRESS for 2s [ 601.991888] env[64436]: INFO networking_nsxv3.common.synchronization [req-f99815e4-7e6a-4b82-8ce9-db0a8e6953df req-2ca0b2d4-352c-4cfe-a55a-4507fcc082d0 tempest-DeleteServersAdminTestJSON-48215762 tempest-DeleteServersAdminTestJSON-48215762-project-member] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 601.992153] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 601.992671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.992789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.992864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.993077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.993220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.993320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.993380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.993554] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.993615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.994056] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.036216] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.036381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.037021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.037021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.037021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.046719] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: IN_PROGRESS for 2s [ 602.168133] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.168549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.168549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.171435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.171435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.171435] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 already deleted. [ 602.171435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.171435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.171435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.171435] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.278136] env[64436]: INFO networking_nsxv3.common.synchronization [req-044f999f-e9b0-4e52-9481-90f7f26a30f0 req-ce31c80c-cc3e-47b8-8d4f-053f87afbcf5 service nova] Enqueued Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_rules [ 602.278199] env[64436]: INFO networking_nsxv3.common.synchronization [req-044f999f-e9b0-4e52-9481-90f7f26a30f0 req-ce31c80c-cc3e-47b8-8d4f-053f87afbcf5 service nova] Enqueued Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_members [ 602.278362] env[64436]: INFO networking_nsxv3.common.synchronization [req-044f999f-e9b0-4e52-9481-90f7f26a30f0 req-ce31c80c-cc3e-47b8-8d4f-053f87afbcf5 service nova] Enqueued Resource ID: 9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e with Priority: HIGHEST for action port [ 602.278773] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_rules [ 602.278995] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_members [ 602.279142] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e with Priority: HIGHEST for action port [ 602.279842] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.280041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.280112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.280430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.280537] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.281744] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.281744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.281891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.282079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.283232] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.283504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.283504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.283657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.283657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.284853] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.284853] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.284853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.284853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.284853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.285258] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.500366] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.500366] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.500366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.500366] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be updated. [ 602.528208] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.530151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.530151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.530151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.530151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.540211] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: IN_PROGRESS for 2s [ 602.696189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.696189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.696189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.696189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.696189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.696189] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 already deleted. [ 602.696189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.740932] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.741151] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.741277] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.741539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.741794] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.741944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.745709] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.745947] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.746185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.746329] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.746749] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.746749] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.746749] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.746749] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.746897] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.747037] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.766392] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.766458] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 602.768897] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.768897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.768897] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-72ea4a71-1d88-452e-84b7-099a8836cee9 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.768897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.768897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.768897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.768897] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72ea4a71-1d88-452e-84b7-099a8836cee9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.789126] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.789918] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.789918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.790477] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e with status ACTIVE [ 602.790786] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.790786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.790930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.791041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.791128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.791299] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.792222] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.792222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.792763] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e is going to be updated. [ 602.814375] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.814375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.814375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.814375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.814375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.814842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9010ba8e-b7ea-4e3b-bf43-1c0eee4d638e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.965571] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: SUCCESS [ 602.965818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.966035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.966253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.966336] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.270673] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.271813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.271813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.271813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.271813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.271813] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 72ea4a71-1d88-452e-84b7-099a8836cee9 not found, creating... [ 603.271813] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.272010] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.272856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.272856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.272856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.272856] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.272856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.273232] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.273232] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.273310] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.273481] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 72ea4a71-1d88-452e-84b7-099a8836cee9 is going to be created. [ 603.291306] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.293798] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.293798] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.293798] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.293798] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.294059] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.294242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.417905] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: SUCCESS [ 603.417905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.418132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.418481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.418752] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.419034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.419811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.419811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.419811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.419811] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.421074] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 603.422460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.422460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.422460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.422460] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.422460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.422460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.422460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.422460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.422460] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.468536] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.468802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.490271] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 603.490456] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 deletion is rescheduled due to dependency. [ 603.490576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.700296] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: SUCCESS [ 603.700537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.700705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.700926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.701160] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.701270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.701334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.701468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.701549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.701632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.701720] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.795582] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.795757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.795757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.796137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.796137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.796282] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 is going to be created. [ 603.817695] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.817827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.817827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.818422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.818422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.827225] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 in Status: UNINITIALIZED for 2s [ 603.924435] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.925486] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.003140] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: SUCCESS [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.003140] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.003140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.003140] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.053454] env[64436]: INFO networking_nsxv3.common.synchronization [req-f99815e4-7e6a-4b82-8ce9-db0a8e6953df req-9b7e30fe-a0f2-4fed-8792-d9878994f8f1 service nova] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_rules [ 604.053793] env[64436]: INFO networking_nsxv3.common.synchronization [req-f99815e4-7e6a-4b82-8ce9-db0a8e6953df req-9b7e30fe-a0f2-4fed-8792-d9878994f8f1 service nova] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 604.053865] env[64436]: INFO networking_nsxv3.common.synchronization [req-f99815e4-7e6a-4b82-8ce9-db0a8e6953df req-9b7e30fe-a0f2-4fed-8792-d9878994f8f1 service nova] Enqueued Resource ID: 72ea4a71-1d88-452e-84b7-099a8836cee9 with Priority: HIGHEST for action port [ 604.054969] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_rules [ 604.055143] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 604.055372] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ea4a71-1d88-452e-84b7-099a8836cee9 with Priority: HIGHEST for action port [ 604.055638] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.056487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.056487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.056774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.056884] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.058117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.058117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.058411] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-72ea4a71-1d88-452e-84b7-099a8836cee9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.058897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.058897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.058897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.058897] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72ea4a71-1d88-452e-84b7-099a8836cee9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.061212] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: SUCCESS [ 604.061463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.207807] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.427098] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.428085] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.508780] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.508780] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.508780] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.508780] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.508780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.510771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.510771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.510771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.510771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.510771] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.552868] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: SUCCESS [ 604.553062] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 deletion is rescheduled due to dependency. [ 604.553210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.553771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.554028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.554230] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.554356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.554421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.554571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.554647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.554758] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.560407] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.560498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.563913] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72ea4a71-1d88-452e-84b7-099a8836cee9 with status ACTIVE [ 604.564262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.564429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.564497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.564920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.565055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.565257] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.566239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.566239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.566239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.566239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.566239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.566239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.566239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.566239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.566485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.566485] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72ea4a71-1d88-452e-84b7-099a8836cee9 is going to be updated. [ 604.588946] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.588946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.588946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.588946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.588946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.589439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72ea4a71-1d88-452e-84b7-099a8836cee9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.709801] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73a0cec9-fcd4-4729-abd7-b50d1439753c: rpc.has_security_group_logging(os_id): False [ 604.729450] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.729586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.729654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.729865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.729954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.730245] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.730373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.730434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.730589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.730679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.730767] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c is going to be created. [ 604.800893] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.800893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.800893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.800893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.801103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.812596] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: IN_PROGRESS for 2s [ 604.937067] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.937259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.937334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.937548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.937641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.937740] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be updated. [ 604.939050] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.939173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.939242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.939409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.939493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.939581] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 604.979684] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.979975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.980091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.980411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.980482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.982763] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.982999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.982999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.983255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.983328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.008372] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: IN_PROGRESS for 2s [ 605.009152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 605.013265] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39b1f9d7-0460-4fa5-8bf2-270d994f79e5: rpc.has_security_group_logging(os_id): False [ 605.031557] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.031666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.031666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.031881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.031977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.032332] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.032332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.032480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.032545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.032622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.033204] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.033204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.033204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.033204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.033411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.033467] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.033565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.033630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.033775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.033853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.033946] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be updated. [ 605.059277] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.090731] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.092475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.092475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.092475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.092475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.143486] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: IN_PROGRESS for 2s [ 605.564434] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.838713] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 in Status: SUCCESS [ 605.838936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.839493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.839716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.840643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.840785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 605.840860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.841062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 605.841153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.841247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 605.841332] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.072582] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.074034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.074034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.074034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.074034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.074034] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be updated. [ 606.117508] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.117508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.117508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.117994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.118179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.129197] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: IN_PROGRESS for 2s [ 606.201358] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d8537d6e-080e-421e-abaf-fe6a7502c175 None None] Enqueued Resource ID: 626d39fc-58fa-4547-bb51-dedc045e2c7a with Priority: HIGHEST for action port [ 606.201762] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626d39fc-58fa-4547-bb51-dedc045e2c7a with Priority: HIGHEST for action port [ 606.202145] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-626d39fc-58fa-4547-bb51-dedc045e2c7a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.202385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-626d39fc-58fa-4547-bb51-dedc045e2c7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.202385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-626d39fc-58fa-4547-bb51-dedc045e2c7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.202614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-626d39fc-58fa-4547-bb51-dedc045e2c7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.202708] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('626d39fc-58fa-4547-bb51-dedc045e2c7a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.344833] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.345200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.345310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.345599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.345783] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.345951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.346118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.346345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.346451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.346570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.346798] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.346905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.347009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.347209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.347381] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.347484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.347553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.347758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.347863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.347951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.348057] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.706777] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 626d39fc-58fa-4547-bb51-dedc045e2c7a [ 606.706777] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.706777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.706777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.706777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.706777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.706777] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:626d39fc-58fa-4547-bb51-dedc045e2c7a already deleted. [ 606.706777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-626d39fc-58fa-4547-bb51-dedc045e2c7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.825561] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: SUCCESS [ 606.825561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.851903] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7489998c-5de5-4c9f-ad50-b496d0a60343: rpc.has_security_group_logging(os_id): False [ 606.869933] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.873105] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.873105] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.873105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.873627] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.873627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.873627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.873627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.873627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.873816] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 is going to be created. [ 606.925851] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.926037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.926124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.926337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.926528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.936366] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 in Status: IN_PROGRESS for 2s [ 607.021769] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.021769] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.021769] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.021769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.022271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.022271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.022271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.022271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.022377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.022444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.022525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.022609] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.024140] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: SUCCESS [ 607.024346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.024500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.024670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.024821] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.024918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.024983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.025147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.025224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.025309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.025396] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.166473] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: SUCCESS [ 607.166706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.527638] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9741d578-5b29-42b0-b0b6-dfd97b1c7306: rpc.has_security_group_logging(os_id): False [ 607.528815] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.545899] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.546147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.546315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.546541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.546701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.546826] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.547018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.547098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.547931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.547931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.547931] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.547931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.547931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.548464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.548464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.548525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.548771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.548771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.548957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.549017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.549121] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 607.603508] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.603508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.603508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.603642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.603786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.617205] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 608.034259] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c2d8d81-8cc8-44df-9d77-63cb789204d8: rpc.has_security_group_logging(os_id): False [ 608.053024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.053024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.053024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.053024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be updated. [ 608.111020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.111020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.111020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.111020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.111020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.121835] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: IN_PROGRESS for 2s [ 608.141021] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: SUCCESS [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.141021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.141021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.141021] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.461310] env[64436]: INFO networking_nsxv3.common.synchronization [None req-21bce4f2-add8-4c66-bc9b-d24db2bc6ee6 None None] Enqueued Resource ID: 3be628e7-e3e7-483d-9a72-d4f21d2959ef with Priority: HIGHEST for action port [ 608.461707] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be628e7-e3e7-483d-9a72-d4f21d2959ef with Priority: HIGHEST for action port [ 608.462418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be628e7-e3e7-483d-9a72-d4f21d2959ef taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.462418] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be628e7-e3e7-483d-9a72-d4f21d2959ef" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.462418] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be628e7-e3e7-483d-9a72-d4f21d2959ef" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.462689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be628e7-e3e7-483d-9a72-d4f21d2959ef" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.462780] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be628e7-e3e7-483d-9a72-d4f21d2959ef',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.645216] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.645216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.645216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.645216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.645216] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.645216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.645509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.645509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.645820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.645820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.645900] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.646048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.646107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.646253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.646447] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.646543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.646622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.646782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.646887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.646980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.648059] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.817774] env[64436]: INFO networking_nsxv3.common.synchronization [req-717f95dc-1771-45c3-af9e-13374c59eb3e req-cc8d4576-326e-444a-8d15-b16d1791ea4e tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 608.817972] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 608.822014] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.822014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.822192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.822369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.822567] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.822772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.822772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.822857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.822903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.823064] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.951678] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 in Status: SUCCESS [ 608.951838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.972263] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3be628e7-e3e7-483d-9a72-d4f21d2959ef [ 608.972598] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.972759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.973162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.973162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.974034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.974034] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3be628e7-e3e7-483d-9a72-d4f21d2959ef already deleted. [ 608.974034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be628e7-e3e7-483d-9a72-d4f21d2959ef" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.151151] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a495b570-59ee-467c-baf8-b41b06814023: rpc.has_security_group_logging(os_id): False [ 609.179775] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.181559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.181559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.181559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.181559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.181559] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.181774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.181774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.181853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.182028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.182154] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.182241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.182305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.182438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.182509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.182824] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.182824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.182942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.183253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.183253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.183253] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be updated. [ 609.245860] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.245860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.245860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.245860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.245860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.264424] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: IN_PROGRESS for 2s [ 609.308279] env[64436]: INFO networking_nsxv3.common.synchronization [req-5eff773e-fcd4-443c-8854-3bbe96206f12 req-580450a8-3a31-4181-84c3-aac5c7dc3129 tempest-AttachInterfacesV270Test-706040131 tempest-AttachInterfacesV270Test-706040131-project-member] Enqueued Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_members [ 609.310373] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGHEST for action security_group_members [ 609.310373] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.310373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.310373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.310514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.310574] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.310895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.310895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.310973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.311075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.311174] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.325337] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.325449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.325449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.326027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.326027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.326027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.326027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.326223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.326223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.326320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.326396] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab already deleted. [ 609.326476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.458091] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.458298] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.458422] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.458743] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.459009] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.459365] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.459679] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.459958] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.460177] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.460442] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.460679] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.460742] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.460898] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.461070] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.461232] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.461407] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.481129] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.481392] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 609.482575] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.482838] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.483223] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.487020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.487020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.487020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.487020] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bd1bb05-d218-4595-a488-bd6bbb30ca1a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.630921] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 609.631300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.631523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.631774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.631904] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.813533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.815285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.815285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.815285] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0c7f357-fb7f-4089-8ca6-73477491c51b is going to be updated. [ 609.843239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.843389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.843460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.843667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.843814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.852667] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0c7f357-fb7f-4089-8ca6-73477491c51b in Status: IN_PROGRESS for 2s [ 609.992569] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.992569] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 5bd1bb05-d218-4595-a488-bd6bbb30ca1a not found, creating... [ 609.992569] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.992569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.993178] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.993178] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 609.993178] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.993178] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 609.993178] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 609.993178] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 5bd1bb05-d218-4595-a488-bd6bbb30ca1a is going to be created. [ 610.015215] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.016788] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.016999] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.017337] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.017787] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.018403] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.134528] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.134716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.134770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.135056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.135363] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.135363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.135511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.135573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.135646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.135740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.135816] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.139497] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: SUCCESS [ 610.139887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.637883] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.638181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.638181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.638701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.638701] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.638701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.638701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.638892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.638892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.639307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.639307] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.639307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.639460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.639490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.639634] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.639720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.639780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.639927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.640019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.640108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.640197] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.818938] env[64436]: INFO networking_nsxv3.common.synchronization [req-717f95dc-1771-45c3-af9e-13374c59eb3e req-e1a82a27-86a6-4f59-9123-0c27ae2fe5b7 service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 610.819142] env[64436]: INFO networking_nsxv3.common.synchronization [req-717f95dc-1771-45c3-af9e-13374c59eb3e req-e1a82a27-86a6-4f59-9123-0c27ae2fe5b7 service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 610.819214] env[64436]: INFO networking_nsxv3.common.synchronization [req-717f95dc-1771-45c3-af9e-13374c59eb3e req-e1a82a27-86a6-4f59-9123-0c27ae2fe5b7 service nova] Enqueued Resource ID: 5bd1bb05-d218-4595-a488-bd6bbb30ca1a with Priority: HIGHEST for action port [ 610.819454] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 610.819625] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 610.819736] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd1bb05-d218-4595-a488-bd6bbb30ca1a with Priority: HIGHEST for action port [ 610.820516] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.820672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.820743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.821043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.821149] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.821999] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.822217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.822407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.822652] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.822732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.822854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.822940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.823058] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.823874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.824181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.824366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.824448] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bd1bb05-d218-4595-a488-bd6bbb30ca1a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.144404] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9741d578-5b29-42b0-b0b6-dfd97b1c7306: rpc.has_security_group_logging(os_id): False [ 611.169170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.169170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.169170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.169613] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.169613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.169613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.169613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.169613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.169750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.169830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.169886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.170027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.170095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.170177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 611.244819] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.244936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.244996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.245288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.245762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.260305] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 611.282410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: SUCCESS [ 611.282410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.325933] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.326780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.327052] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.327943] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bd1bb05-d218-4595-a488-bd6bbb30ca1a with status ACTIVE [ 611.328152] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.328258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.328322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.329559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.329710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.333608] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.333608] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.333608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.333608] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bd1bb05-d218-4595-a488-bd6bbb30ca1a is going to be updated. [ 611.352256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.352256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.352256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.352256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.352256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.352256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bd1bb05-d218-4595-a488-bd6bbb30ca1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.353024] env[64436]: INFO networking_nsxv3.common.synchronization [req-135bb9f0-83f1-443b-9d06-36cdd0d498e6 req-5c114b05-2407-4b63-82a5-eac0cee83807 tempest-VolumesAdminNegativeTest-1750673227 tempest-VolumesAdminNegativeTest-1750673227-project-member] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_members [ 611.353582] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_members [ 611.354117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.354269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.354593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.354593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.354787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.354787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.355036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.355155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.355235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.355384] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.834148] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.858033] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.858033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.858174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.858306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.858396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.858594] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.858691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.858749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.858947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.859042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.859124] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 already deleted. [ 611.859203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.863394] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0c7f357-fb7f-4089-8ca6-73477491c51b in Status: SUCCESS [ 611.863653] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0c7f357-fb7f-4089-8ca6-73477491c51b deletion is rescheduled due to dependency. [ 611.863767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.891607] env[64436]: INFO networking_nsxv3.common.synchronization [req-094acc08-1f9c-4ef0-a708-af7bd7a9d212 req-494ad810-7b25-4d24-af35-32bafc8f51ee tempest-ServersAdminNegativeTestJSON-837803547 tempest-ServersAdminNegativeTestJSON-837803547-project-member] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 611.893009] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 611.893655] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.894183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.894183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.894183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.894279] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.894354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.894415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.894640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.894727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.894844] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.988514] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.988514] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.988710] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.988948] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.994796] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.994796] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.994796] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.994796] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.994796] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.994796] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.994796] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.994796] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.994796] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.994796] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.994796] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.995239] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.013014] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.013208] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 612.013350] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.013533] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.013848] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ecb89321-16cd-47d3-9e2e-ad96f742273b taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.014516] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.014516] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.014516] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.014624] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecb89321-16cd-47d3-9e2e-ad96f742273b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.339400] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.339575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.339668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.339867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.339963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.340080] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be created. [ 612.365827] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.366663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.369248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.369505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.369873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.378342] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: UNINITIALIZED for 2s [ 612.396917] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.518882] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.519073] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.519711] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.520115] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.520363] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.520709] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ecb89321-16cd-47d3-9e2e-ad96f742273b not found, creating... [ 612.521162] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.521331] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.521987] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.522313] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.522548] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.522946] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.523087] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.523253] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.523654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.523854] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.524057] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ecb89321-16cd-47d3-9e2e-ad96f742273b is going to be created. [ 612.546319] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.546566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.546718] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.547040] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.547476] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.547540] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.899174] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.277590] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 613.278130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.406105] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.406105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.406105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.406105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.406105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.406105] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7502962-276d-43f0-96f0-2447f12d3137 is going to be updated. [ 613.433562] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.433717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.433786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.434027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.434172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.443299] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: IN_PROGRESS for 2s [ 613.452602] env[64436]: INFO networking_nsxv3.common.synchronization [req-135bb9f0-83f1-443b-9d06-36cdd0d498e6 req-18302540-01dc-46a8-8945-604b8228d1a2 service nova] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_rules [ 613.452828] env[64436]: INFO networking_nsxv3.common.synchronization [req-135bb9f0-83f1-443b-9d06-36cdd0d498e6 req-18302540-01dc-46a8-8945-604b8228d1a2 service nova] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_members [ 613.453022] env[64436]: INFO networking_nsxv3.common.synchronization [req-135bb9f0-83f1-443b-9d06-36cdd0d498e6 req-18302540-01dc-46a8-8945-604b8228d1a2 service nova] Enqueued Resource ID: ecb89321-16cd-47d3-9e2e-ad96f742273b with Priority: HIGHEST for action port [ 613.453662] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_rules [ 613.453876] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_members [ 613.454068] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecb89321-16cd-47d3-9e2e-ad96f742273b with Priority: HIGHEST for action port [ 613.454372] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.454552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.454763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.454913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.455043] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.456446] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.456446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.456446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.456864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.457105] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.457282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.457389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.457593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.457803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.457867] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.459032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecb89321-16cd-47d3-9e2e-ad96f742273b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.459777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.460110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.460110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.460282] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecb89321-16cd-47d3-9e2e-ad96f742273b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.964533] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecb89321-16cd-47d3-9e2e-ad96f742273b with status ACTIVE [ 613.964795] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.964795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.964893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.965451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.965451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.965451] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.965451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.965649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.965649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.965747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.965896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.966088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.966088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.966585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.966585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.966585] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecb89321-16cd-47d3-9e2e-ad96f742273b is going to be updated. [ 613.968291] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.970302] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.970444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.989343] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.989539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.989539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.989741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.989878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.990058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecb89321-16cd-47d3-9e2e-ad96f742273b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.387484] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 614.387774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.388016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.388984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.389295] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.389434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.389504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.389691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.389778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.389867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.389976] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.471638] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.893755] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.893755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.893755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.893951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.894031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.894360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.894360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.894360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.894458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.894495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.894957] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.894957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.894957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.894957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.895118] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.895155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.895187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.895319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.895390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.895466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.895551] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.974335] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.975035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 614.975286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.975673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 614.975938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 614.976244] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 is going to be created. [ 615.001858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.001858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.002139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.002273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.002518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.013036] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: UNINITIALIZED for 2s [ 615.398527] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f75433d-92b0-49c0-b145-a45f748925ab: rpc.has_security_group_logging(os_id): False [ 615.416617] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.417096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.417096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.417188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.417220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.417439] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.417556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.417619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.417795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.417887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.418119] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.418216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.418278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.418427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.418499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.418689] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.418780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.418841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.418977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.419066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.419152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be created. [ 615.451261] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: SUCCESS [ 615.451469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.479775] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.479927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.480032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.480244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.480468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.489387] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 616.220138] env[64436]: INFO networking_nsxv3.common.synchronization [req-025212e5-e95e-45e2-98af-5c04d5a5a04a req-e34382b0-bc83-4baf-bbd8-e43c8851e9d4 tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 616.220774] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 616.221513] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.221888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.221888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.222025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.222141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.222272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.222347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.222518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.222603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.222699] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.724940] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.725125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.725201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.725428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.725520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.725720] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.725818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.725879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.726043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.726137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.726225] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 already deleted. [ 616.726317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.744433] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.744695] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.744859] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.745271] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.745529] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.745687] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.745804] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.746042] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.746206] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.746415] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.746531] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.746642] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.746751] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.746857] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.746962] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.747139] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.773460] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.773684] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 616.773825] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.774092] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.774795] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-f83b317d-244e-4d51-81f4-8b771ec6f327 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.774891] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.774972] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.775296] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.775453] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f83b317d-244e-4d51-81f4-8b771ec6f327',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.021830] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: SUCCESS [ 617.022202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.022569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.022917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.024049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.024049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.024049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.024293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.024392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.025101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.025101] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.278285] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.278612] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.278656] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.278961] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.279187] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.279357] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port f83b317d-244e-4d51-81f4-8b771ec6f327 not found, creating... [ 617.279580] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.279736] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.279848] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.280095] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.280236] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.280509] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.280661] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.280774] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.280979] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.281197] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.281338] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: f83b317d-244e-4d51-81f4-8b771ec6f327 is going to be created. [ 617.300343] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.300651] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.300823] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.301119] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.301351] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.301568] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.502682] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 617.502957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.528541] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.033538] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23b08457-f786-4357-ae40-5bf7a012b659: rpc.has_security_group_logging(os_id): False [ 618.049146] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.049632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.049801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.050096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.050274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.050592] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.050794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.050923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.051198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.051454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.051677] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 is going to be created. [ 618.108126] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.108126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.108126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.108126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.108126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.118674] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: IN_PROGRESS for 2s [ 618.443189] env[64436]: INFO networking_nsxv3.common.synchronization [req-025212e5-e95e-45e2-98af-5c04d5a5a04a req-2c34499c-1c4c-4b3b-8b57-054108b3ddab service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 618.443189] env[64436]: INFO networking_nsxv3.common.synchronization [req-025212e5-e95e-45e2-98af-5c04d5a5a04a req-2c34499c-1c4c-4b3b-8b57-054108b3ddab service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 618.443189] env[64436]: INFO networking_nsxv3.common.synchronization [req-025212e5-e95e-45e2-98af-5c04d5a5a04a req-2c34499c-1c4c-4b3b-8b57-054108b3ddab service nova] Enqueued Resource ID: f83b317d-244e-4d51-81f4-8b771ec6f327 with Priority: HIGHEST for action port [ 618.443189] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 618.443189] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 618.443189] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f83b317d-244e-4d51-81f4-8b771ec6f327 with Priority: HIGHEST for action port [ 618.443189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.443189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.443189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.444100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.444319] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.445252] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.445520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.445803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.446149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.446686] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.446943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.447262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.448702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.448702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.448702] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.450027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-f83b317d-244e-4d51-81f4-8b771ec6f327 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.450027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.450027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.450027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.450027] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f83b317d-244e-4d51-81f4-8b771ec6f327',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.472139] env[64436]: INFO networking_nsxv3.common.synchronization [req-fb5af57d-e04a-434c-b0db-364aa6c6880e req-678fe7b5-94a7-4c77-9752-50cd032a2026 tempest-DeleteServersAdminTestJSON-48215762 tempest-DeleteServersAdminTestJSON-48215762-project-member] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 618.473497] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGHEST for action security_group_members [ 618.474145] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.474315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.474384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.474595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.474770] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.474871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.474961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.475133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.475240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.475365] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.495699] env[64436]: INFO networking_nsxv3.common.synchronization [req-be774b74-afb3-4234-bd91-fcf64e312e88 req-111057c5-2a42-48d6-9bab-b6bcd3cffe5c tempest-ServersNegativeTestMultiTenantJSON-694526049 tempest-ServersNegativeTestMultiTenantJSON-694526049-project-member] Enqueued Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_members [ 618.496468] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGHEST for action security_group_members [ 618.497642] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.497774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.497866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.498284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.498509] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.498678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.498762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.499040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.499196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.499573] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.937520] env[64436]: INFO networking_nsxv3.common.synchronization [req-f4a9ad7f-b9c4-4f14-a609-dc0ef449981b req-8bb53d00-08be-4fbe-8489-4c8c59331cc1 tempest-ServerActionsV293TestJSON-1533962128 tempest-ServerActionsV293TestJSON-1533962128-project-member] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_members [ 618.938095] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_members [ 618.938492] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.940021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.940021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.940021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.940021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.940321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.940321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.940321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.940416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.940764] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.953024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.953024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.953024] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.953164] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f83b317d-244e-4d51-81f4-8b771ec6f327 with status ACTIVE [ 618.953508] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.956015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.956015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.956015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.956015] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f83b317d-244e-4d51-81f4-8b771ec6f327 is going to be updated. [ 618.976824] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.976974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.977152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.977291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.977394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.977553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f83b317d-244e-4d51-81f4-8b771ec6f327" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.977840] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.977942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.978019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.978176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.978258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.978427] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.978518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.978567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.978703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.978778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.978862] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be updated. [ 619.007301] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.007301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.007301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.007569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.007600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.009250] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.009250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.009250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.009250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.009250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.009624] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.009624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.009695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.009809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.009887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.009975] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 is going to be updated. [ 619.019265] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: IN_PROGRESS for 2s [ 619.078701] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.078907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.079076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.079249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.079417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.094345] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 in Status: IN_PROGRESS for 2s [ 619.314205] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.314420] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-629" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.314856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-629" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.315225] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-629" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.315486] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.315638] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.315752] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.316332] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.316540] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.316789] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.316937] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.317237] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.317402] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.317550] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.317690] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.317866] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.343950] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.343950] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 619.343950] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.344120] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-629" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.344415] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-e201ad36-c583-48ee-a910-9a5dec980775 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.344590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.344771] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.345217] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.345458] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e201ad36-c583-48ee-a910-9a5dec980775',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.444776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.444776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.444776] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba already deleted. [ 619.444776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.458007] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.850973] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.851269] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.851436] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.851690] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.851917] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.852133] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port e201ad36-c583-48ee-a910-9a5dec980775 not found, creating... [ 619.852630] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.852711] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.852917] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.853217] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.853365] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.853649] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.853802] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.853929] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.854837] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.855087] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.855384] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: e201ad36-c583-48ee-a910-9a5dec980775 is going to be created. [ 619.874268] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.874487] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.874613] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.875278] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.875278] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.875373] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.960129] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.960305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.960381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.960608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.960707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.960807] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be created. [ 620.006966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.007124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.007195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.007411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.007583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.017086] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: UNINITIALIZED for 2s [ 620.130246] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: SUCCESS [ 620.130411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.763451] env[64436]: INFO networking_nsxv3.common.synchronization [req-f4a9ad7f-b9c4-4f14-a609-dc0ef449981b req-2379ef7e-6454-40ba-852a-a1681e35cd09 service nova] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_rules [ 620.767688] env[64436]: INFO networking_nsxv3.common.synchronization [req-f4a9ad7f-b9c4-4f14-a609-dc0ef449981b req-2379ef7e-6454-40ba-852a-a1681e35cd09 service nova] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_members [ 620.767688] env[64436]: INFO networking_nsxv3.common.synchronization [req-f4a9ad7f-b9c4-4f14-a609-dc0ef449981b req-2379ef7e-6454-40ba-852a-a1681e35cd09 service nova] Enqueued Resource ID: e201ad36-c583-48ee-a910-9a5dec980775 with Priority: HIGHEST for action port [ 620.768952] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_rules [ 620.768952] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_members [ 620.768952] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e201ad36-c583-48ee-a910-9a5dec980775 with Priority: HIGHEST for action port [ 620.769305] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.769614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.769721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.769968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.770716] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.771218] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.771435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.771435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.771683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.775023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.775023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.775023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.775023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.775023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.775023] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.775023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e201ad36-c583-48ee-a910-9a5dec980775 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.775023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.775023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.775023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.775023] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e201ad36-c583-48ee-a910-9a5dec980775',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.028534] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a495b570-59ee-467c-baf8-b41b06814023 in Status: SUCCESS [ 621.028732] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a495b570-59ee-467c-baf8-b41b06814023 deletion is rescheduled due to dependency. [ 621.028856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.105239] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 in Status: SUCCESS [ 621.105281] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 deletion is rescheduled due to dependency. [ 621.105410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.275545] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.275673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.276249] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.277728] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e201ad36-c583-48ee-a910-9a5dec980775 with status ACTIVE [ 621.277911] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.278051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.278121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.278326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.279080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.279080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.279080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.279080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.279080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.279080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.284147] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.284147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.284147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.284147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.284147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.284147] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e201ad36-c583-48ee-a910-9a5dec980775 is going to be updated. [ 621.305229] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.305390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.305442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.310022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.310022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.310022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e201ad36-c583-48ee-a910-9a5dec980775" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.694253] env[64436]: INFO networking_nsxv3.common.synchronization [req-df61d4c6-f259-4bd2-98e8-828126c872b1 req-a92bc9b1-cc24-4e4a-b6e7-758c186f043d tempest-FloatingIPsAssociationTestJSON-1278161632 tempest-FloatingIPsAssociationTestJSON-1278161632-project-member] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 621.695152] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 621.695508] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.695663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.695892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.696229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.696423] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.696560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.696646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.696837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.696953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.698038] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.786232] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.027324] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 622.027324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.027482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.027739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.027930] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.028087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.028191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.028525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.028525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.030077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.030077] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.200441] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.289057] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.289228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.289437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.289533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.289626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.289748] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba is going to be created. [ 622.313191] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.313335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.313405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.313616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.313775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.322508] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: UNINITIALIZED for 2s [ 622.531059] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.532076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.532076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.532076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.532076] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.532076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.532076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.532475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.532475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.532475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.532475] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.532670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.532670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.532760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.532859] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.532955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.533023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.533195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.533269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.533328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.533417] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.624359] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b00944a0-4f10-4691-8f68-a91e8ac62df4 None None] Enqueued Resource ID: a69eb06f-ae00-4310-9157-d25d747f5a0c with Priority: HIGHEST for action port [ 622.624359] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a69eb06f-ae00-4310-9157-d25d747f5a0c with Priority: HIGHEST for action port [ 622.624795] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a69eb06f-ae00-4310-9157-d25d747f5a0c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.624916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a69eb06f-ae00-4310-9157-d25d747f5a0c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.625064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a69eb06f-ae00-4310-9157-d25d747f5a0c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.625326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a69eb06f-ae00-4310-9157-d25d747f5a0c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.625419] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a69eb06f-ae00-4310-9157-d25d747f5a0c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.703090] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.036842] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a22f030d-b590-48f1-adde-d139f2aa31d4: rpc.has_security_group_logging(os_id): False [ 623.060846] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.060919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.060980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.061181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.061274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.061992] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.062152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.062230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.062511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.062511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.062691] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.062765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.062837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.062951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.063074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.063293] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.067022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.067022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.067022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.067022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.067022] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be created. [ 623.134206] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.134206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.134206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.134206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.134206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.138633] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a69eb06f-ae00-4310-9157-d25d747f5a0c [ 623.138633] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.138633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.138633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.138633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.138633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.138633] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a69eb06f-ae00-4310-9157-d25d747f5a0c already deleted. [ 623.138633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a69eb06f-ae00-4310-9157-d25d747f5a0c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.149123] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 623.206954] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.206954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.206954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.207173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.209491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.209491] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be updated. [ 623.261273] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.261426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.261464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.261873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.261873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.270763] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: IN_PROGRESS for 2s [ 624.014654] env[64436]: INFO networking_nsxv3.common.synchronization [req-fec5ad0e-0abb-4148-8755-f2bc92e58cc8 req-67c00ea2-0038-4c0f-a5b6-1523be9ebf1e tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 624.015213] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 624.015452] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.015578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.015835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.015835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.016011] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.020021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.020021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.020021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.020021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.020021] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.335845] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: SUCCESS [ 624.336239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.336355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.336617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.336758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.336876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.336946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.337142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.337237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.337332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.337422] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.522048] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.522432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.522491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.522759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.522881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.523342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.524413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.524593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.524800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.524893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.525040] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 624.554850] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.556032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.556032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.556032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.556032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.569712] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 624.670707] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f873fb6b-f07e-4774-99f7-70126e83eca5 tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 624.671274] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 624.671574] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.671697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.671766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.672016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.673186] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.848281] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.891995] env[64436]: INFO networking_nsxv3.common.synchronization [None req-47d54b43-fe2c-451a-9a32-435c637cc6ef tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 624.891995] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 624.891995] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.891995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.163631] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 625.163858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.221750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.221909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.221977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.222311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.222414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.223192] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a already deleted. [ 625.223309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.223479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.223655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.223808] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.284059] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: SUCCESS [ 625.284226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.350208] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8d51f49-2f07-4baa-93f3-f28849ea55ba: rpc.has_security_group_logging(os_id): False [ 625.373760] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.373760] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.373760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.373760] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba is going to be created. [ 625.389099] env[64436]: INFO networking_nsxv3.common.synchronization [None req-48560dd9-9b59-4d30-96b8-bf10eeb41c74 None None] Enqueued Resource ID: 06db69e4-f842-4016-8238-1da586c07261 with Priority: HIGHEST for action port [ 625.389786] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06db69e4-f842-4016-8238-1da586c07261 with Priority: HIGHEST for action port [ 625.390146] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-06db69e4-f842-4016-8238-1da586c07261 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.390290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06db69e4-f842-4016-8238-1da586c07261" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.390354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06db69e4-f842-4016-8238-1da586c07261" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.391318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06db69e4-f842-4016-8238-1da586c07261" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.391459] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06db69e4-f842-4016-8238-1da586c07261',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.451060] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.451060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.451060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.451060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.451060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.469462] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: IN_PROGRESS for 2s [ 625.751905] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.752037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.752118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.752338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.752432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.752529] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a already deleted. [ 625.752610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.896937] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06db69e4-f842-4016-8238-1da586c07261 [ 625.896937] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.896937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.896937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.896937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.896937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.896937] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06db69e4-f842-4016-8238-1da586c07261 already deleted. [ 625.896937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06db69e4-f842-4016-8238-1da586c07261" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.393310] env[64436]: INFO networking_nsxv3.common.synchronization [req-9c93885e-3baf-4199-be02-9eb07b72b671 req-dbefc0e5-5909-4caa-96df-d24751eb05f0 tempest-TenantUsagesTestJSON-1754389054 tempest-TenantUsagesTestJSON-1754389054-project-member] Enqueued Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_members [ 626.393824] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_members [ 626.394188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.394806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.394923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.395215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.395518] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.395645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.395707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.395938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.396156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.396305] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.581264] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 626.581264] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 626.581264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.710756] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.711088] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.711284] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.711622] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.712014] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.712284] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.712463] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.712794] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.713043] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.713361] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.713486] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.713642] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.713788] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.713944] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.714106] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.714271] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.732965] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.733130] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 626.733322] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.733537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.733913] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d6689550-2ca1-4ee5-a710-d2916dfef4a0 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.734087] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.734248] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.734802] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.734802] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6689550-2ca1-4ee5-a710-d2916dfef4a0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.899409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.899691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.899811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.900086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.900205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.900427] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.900519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.900601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.900740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.900817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.900902] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b already deleted. [ 626.900982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.237097] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.237345] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.238052] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.238052] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.238052] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.238172] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d6689550-2ca1-4ee5-a710-d2916dfef4a0 not found, creating... [ 627.238353] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.238525] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.238655] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.238896] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.239064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.239362] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.239539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.239667] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.239897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.240051] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.240214] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d6689550-2ca1-4ee5-a710-d2916dfef4a0 is going to be created. [ 627.258630] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.259469] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.259469] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.259469] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.259598] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.259881] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.480710] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: SUCCESS [ 627.480710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.938119] env[64436]: INFO networking_nsxv3.common.synchronization [req-9c93885e-3baf-4199-be02-9eb07b72b671 req-8cbb0288-3f3b-458e-991f-1ae946ff76bc service nova] Enqueued Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_rules [ 627.938119] env[64436]: INFO networking_nsxv3.common.synchronization [req-9c93885e-3baf-4199-be02-9eb07b72b671 req-8cbb0288-3f3b-458e-991f-1ae946ff76bc service nova] Enqueued Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_members [ 627.938263] env[64436]: INFO networking_nsxv3.common.synchronization [req-9c93885e-3baf-4199-be02-9eb07b72b671 req-8cbb0288-3f3b-458e-991f-1ae946ff76bc service nova] Enqueued Resource ID: d6689550-2ca1-4ee5-a710-d2916dfef4a0 with Priority: HIGHEST for action port [ 627.938542] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_rules [ 627.938676] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_members [ 627.938773] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6689550-2ca1-4ee5-a710-d2916dfef4a0 with Priority: HIGHEST for action port [ 627.939535] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.939668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.939737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.939993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.940091] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.940904] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.941064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.941093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.941253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.941395] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.941578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.941578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.941684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.941769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.941854] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.943009] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6689550-2ca1-4ee5-a710-d2916dfef4a0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.943141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.943218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.943363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.943437] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6689550-2ca1-4ee5-a710-d2916dfef4a0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.445031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.445031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.445031] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.446119] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6689550-2ca1-4ee5-a710-d2916dfef4a0 with status ACTIVE [ 628.446222] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.446343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.446411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.446614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.446701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.446873] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.446970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.447048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.447211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.447285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.447464] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.447556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.447616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.447750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.447825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.447986] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6689550-2ca1-4ee5-a710-d2916dfef4a0 is going to be updated. [ 628.468023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.468023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.468023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.468214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.468432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.468621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6689550-2ca1-4ee5-a710-d2916dfef4a0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.747889] env[64436]: INFO networking_nsxv3.common.synchronization [None req-32eb7fe2-6ce1-4cea-a1a3-50a0e34a9f99 tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 93f98172-ce3a-4260-ad18-0ab06c9b8e14 with Priority: HIGHEST for action security_group_rules [ 628.752077] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f98172-ce3a-4260-ad18-0ab06c9b8e14 with Priority: HIGHEST for action security_group_rules [ 628.752077] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.752077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.752077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.752077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.752077] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f98172-ce3a-4260-ad18-0ab06c9b8e14',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.917964] env[64436]: INFO networking_nsxv3.common.synchronization [None req-c56be014-6bb3-4531-99b8-bc160ed96f7e tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 93f98172-ce3a-4260-ad18-0ab06c9b8e14 with Priority: HIGHEST for action security_group_rules [ 628.918489] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f98172-ce3a-4260-ad18-0ab06c9b8e14 with Priority: HIGHEST for action security_group_rules [ 628.918792] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.918891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.949883] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.273301] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.273301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.273301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.273301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.273301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.273301] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f98172-ce3a-4260-ad18-0ab06c9b8e14 already deleted. [ 629.273490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.273546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.273707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.273790] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93f98172-ce3a-4260-ad18-0ab06c9b8e14',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.454429] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.454429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.454429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.454429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.454429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.454429] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b is going to be created. [ 629.481230] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.481230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.481230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.481230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.481230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.489055] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b in Status: UNINITIALIZED for 2s [ 629.794492] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.794492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.794492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.794492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.794907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.794907] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93f98172-ce3a-4260-ad18-0ab06c9b8e14 already deleted. [ 629.794907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93f98172-ce3a-4260-ad18-0ab06c9b8e14" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.501723] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b in Status: SUCCESS [ 631.501961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.503464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.503464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.503464] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.503464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.503464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.503464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.503464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.503464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.503464] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.005858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.006034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.006110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.006369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.006541] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.006643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.006698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.006852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.006932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.007675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.007675] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.007675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.007675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.007675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.007675] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.007675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.007930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.007930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.008943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.008943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.008943] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.510277] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03fac5b8-8389-4c07-af7a-524dd4e4a24b: rpc.has_security_group_logging(os_id): False [ 632.526805] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.526977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.527038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.527287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.527428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.527659] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.527766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.527820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.527991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.528095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.528355] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.528455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.528567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.528661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.528738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.532280] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.532420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.532456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.532707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.532707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.532828] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b is going to be created. [ 632.590361] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.590361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.590361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.590615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.590859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.603750] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b in Status: IN_PROGRESS for 2s [ 633.412665] env[64436]: INFO networking_nsxv3.common.synchronization [req-76239794-55d1-4f51-9156-765d2b6bde19 req-89deaabb-ff8a-40f0-9a8e-d35b634107cd tempest-MigrationsAdminTest-163149722 tempest-MigrationsAdminTest-163149722-project-member] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 633.413224] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 633.413566] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.413655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.413722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.413955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.416298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.416435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.416518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.416660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.416751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.416934] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.649151] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b2f22481-e663-4988-a4d3-df5cea3ded3f None None] Enqueued Resource ID: 9cc97c3b-7f51-45c5-83ed-0713690c0555 with Priority: HIGHEST for action port [ 633.649416] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc97c3b-7f51-45c5-83ed-0713690c0555 with Priority: HIGHEST for action port [ 633.649983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc97c3b-7f51-45c5-83ed-0713690c0555 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.654018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc97c3b-7f51-45c5-83ed-0713690c0555" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.654018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc97c3b-7f51-45c5-83ed-0713690c0555" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.654018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc97c3b-7f51-45c5-83ed-0713690c0555" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.654018] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc97c3b-7f51-45c5-83ed-0713690c0555',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.919857] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.920061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.920170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.920451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.920552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.920757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.920865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.920914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.921163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.921248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.921335] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 already deleted. [ 633.921413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.160709] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cc97c3b-7f51-45c5-83ed-0713690c0555 [ 634.160977] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.161101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.161101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.161899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.161899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.161899] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cc97c3b-7f51-45c5-83ed-0713690c0555 already deleted. [ 634.161899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc97c3b-7f51-45c5-83ed-0713690c0555" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.162596] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.162789] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.162904] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.163155] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.163432] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.163594] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.163713] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.163981] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.164485] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.164485] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 634.164485] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.164613] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.164692] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.164799] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 634.164900] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.165039] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.195017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.195017] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 634.195017] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.195017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.195017] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-455bae66-2b87-49fd-9594-e68dec8dcdec taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.195017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.195017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.195390] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.195690] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('455bae66-2b87-49fd-9594-e68dec8dcdec',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.617889] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b in Status: SUCCESS [ 634.618144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.699623] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.699623] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.699623] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.700033] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.700033] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.700148] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 455bae66-2b87-49fd-9594-e68dec8dcdec not found, creating... [ 634.700383] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.700543] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.700659] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.700874] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.701017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.701294] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.701450] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.701567] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.701773] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.701910] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.702048] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 455bae66-2b87-49fd-9594-e68dec8dcdec is going to be created. [ 634.721292] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.721499] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.721620] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.722145] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.722145] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.722405] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.424259] env[64436]: INFO networking_nsxv3.common.synchronization [req-76239794-55d1-4f51-9156-765d2b6bde19 req-778fda64-5a18-456b-95f2-e105dc25f2de service nova] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_rules [ 635.424472] env[64436]: INFO networking_nsxv3.common.synchronization [req-76239794-55d1-4f51-9156-765d2b6bde19 req-778fda64-5a18-456b-95f2-e105dc25f2de service nova] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 635.424661] env[64436]: INFO networking_nsxv3.common.synchronization [req-76239794-55d1-4f51-9156-765d2b6bde19 req-778fda64-5a18-456b-95f2-e105dc25f2de service nova] Enqueued Resource ID: 455bae66-2b87-49fd-9594-e68dec8dcdec with Priority: HIGHEST for action port [ 635.424925] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_rules [ 635.425037] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 635.425196] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 455bae66-2b87-49fd-9594-e68dec8dcdec with Priority: HIGHEST for action port [ 635.425694] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.425826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.425895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.426339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.426475] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.427452] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.427624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.427720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.427923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.428131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.428259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.428347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.428523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.428660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.428780] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.429874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-455bae66-2b87-49fd-9594-e68dec8dcdec taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.429874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.429874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.430216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.430216] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('455bae66-2b87-49fd-9594-e68dec8dcdec',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.617921] env[64436]: INFO networking_nsxv3.common.synchronization [None req-a5e0a0ca-bcb8-4de0-b195-36e0baa6bcb2 None None] Enqueued Resource ID: 5967e0ba-f60e-439b-a89d-6b686e34b7ab with Priority: HIGHEST for action port [ 635.620631] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5967e0ba-f60e-439b-a89d-6b686e34b7ab with Priority: HIGHEST for action port [ 635.620631] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5967e0ba-f60e-439b-a89d-6b686e34b7ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.620631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5967e0ba-f60e-439b-a89d-6b686e34b7ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.620631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5967e0ba-f60e-439b-a89d-6b686e34b7ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.620631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5967e0ba-f60e-439b-a89d-6b686e34b7ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.620631] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5967e0ba-f60e-439b-a89d-6b686e34b7ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.844578] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-9059b0bf-df84-40da-a842-98e83cea7ec4 tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 635.844864] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 635.845091] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.845217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.845286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.845865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.845865] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.845865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.845865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.846070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.849226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.849297] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.933517] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.934913] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.935060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.935199] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 455bae66-2b87-49fd-9594-e68dec8dcdec with status ACTIVE [ 635.935366] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.935491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.935555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.935760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.935849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.936029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.936126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.936190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.936365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.936547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.936608] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.936700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.936763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.936893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.936967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.937062] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 455bae66-2b87-49fd-9594-e68dec8dcdec is going to be updated. [ 635.958928] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.959151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.959221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.959448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.959607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.959770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-455bae66-2b87-49fd-9594-e68dec8dcdec" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.122399] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5967e0ba-f60e-439b-a89d-6b686e34b7ab [ 636.122628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.122861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.122861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.123071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.123174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.123272] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5967e0ba-f60e-439b-a89d-6b686e34b7ab already deleted. [ 636.123356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5967e0ba-f60e-439b-a89d-6b686e34b7ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.163642] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.163888] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.164066] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.164493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.164777] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.164945] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.165292] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.165568] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.165735] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.165972] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.166099] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.166220] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.166351] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.166477] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.166579] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.166710] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.190774] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.190774] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 636.190914] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.191159] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.191501] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-75199b3b-c99d-4582-9f07-ea693642014f taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.191703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.191837] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.192174] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.192319] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75199b3b-c99d-4582-9f07-ea693642014f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.351501] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.351501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.351788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.351825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.351936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.352188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.352352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.352417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.352620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.352745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.352841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 already deleted. [ 636.352993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.440040] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.694844] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.694844] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.695459] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.695459] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.695459] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.695786] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 75199b3b-c99d-4582-9f07-ea693642014f not found, creating... [ 636.695912] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.696149] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.696839] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.696839] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.696839] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.697032] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.697135] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.697289] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.698315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.698315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.698315] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 75199b3b-c99d-4582-9f07-ea693642014f is going to be created. [ 636.718045] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.718271] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.718395] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.718699] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.718941] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.719191] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.945603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.945603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.945603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.945603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.945603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.945603] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be created. [ 636.965753] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.965905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.965947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.966141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.966351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.974168] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: UNINITIALIZED for 2s [ 637.427882] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-2e0ba473-57a4-48b2-b921-f80abc4c0121 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 637.428092] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-2e0ba473-57a4-48b2-b921-f80abc4c0121 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 637.428237] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-2e0ba473-57a4-48b2-b921-f80abc4c0121 service nova] Enqueued Resource ID: 75199b3b-c99d-4582-9f07-ea693642014f with Priority: HIGHEST for action port [ 637.428479] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 637.428616] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 637.428717] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75199b3b-c99d-4582-9f07-ea693642014f with Priority: HIGHEST for action port [ 637.429272] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.429429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.429463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.429691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.429769] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.431776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.431889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.431955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.432192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.432345] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.432441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.432502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.432640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.432723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.432810] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.433963] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-75199b3b-c99d-4582-9f07-ea693642014f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.434116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.434216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.434547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.434547] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75199b3b-c99d-4582-9f07-ea693642014f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.936177] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.936487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.936579] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.937507] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75199b3b-c99d-4582-9f07-ea693642014f with status ACTIVE [ 637.937662] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.937777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.937859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.938088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.938136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.938705] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.938705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.938705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.938705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.938705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.938892] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.938933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.938969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.939166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.939246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.939328] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75199b3b-c99d-4582-9f07-ea693642014f is going to be updated. [ 637.963216] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.963216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.963216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.963216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.963216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.963216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75199b3b-c99d-4582-9f07-ea693642014f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.442697] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.946151] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.946151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.946151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.946151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.946151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.946151] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be created. [ 638.967919] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.968302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.968302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.968371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.968538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.979397] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: UNINITIALIZED for 2s [ 638.981477] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 638.981691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.981849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.982094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.982284] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.982417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.982484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.982642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.982739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.982827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.982917] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.485838] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.485838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.485838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.486107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.489515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.489783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.489895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.490171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.490317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.490467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.490705] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.490866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.490962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.491198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.491393] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.491519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.491583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.491758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.491874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.491982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.492135] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.995904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37fe26d6-f782-4509-b81f-40a0eeb20894: rpc.has_security_group_logging(os_id): False [ 640.012992] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.012992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.012992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.013277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.013344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.014534] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.014534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.014534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.014534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.014534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.014534] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.014534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.014534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.015160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.015160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.015160] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.015160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.015160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.015339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.015339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.015339] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be created. [ 640.073466] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.074260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.074260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.074260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.074474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.084782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: IN_PROGRESS for 2s [ 640.420319] env[64436]: INFO networking_nsxv3.common.synchronization [req-2d10e1c2-705c-486c-b2c5-fa295d083d0b req-6cd93b63-4ff9-4cb4-86b6-0a28d752469c tempest-TenantUsagesTestJSON-1754389054 tempest-TenantUsagesTestJSON-1754389054-project-member] Enqueued Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_members [ 640.422075] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGHEST for action security_group_members [ 640.422075] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.422075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.422075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.422075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.422075] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.424025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.424025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.424025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.424025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.424025] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.847364] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-30c77ad5-3558-4fd2-aece-109020e8be0b tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 640.848268] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 640.848268] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.848358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.927349] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.927349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.927349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.927349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.927349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.927349] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.927349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.927349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.928225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.928385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.929444] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b is going to be updated. [ 640.954147] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.954422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.954422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.954599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.954747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.962728] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b in Status: IN_PROGRESS for 2s [ 640.989190] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 640.989569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.989853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.990148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.990363] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.990580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.990580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.990723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.990811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.990898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.992972] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.995262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.995476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.995673] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.995781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.995861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.996019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.996289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.996289] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.153197] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.153526] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.153787] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.154418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.154787] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.155107] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.155313] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.155709] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.155910] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.156206] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.156438] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.156627] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.156777] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.156939] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.157180] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.157335] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.199757] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.199987] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 641.200168] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.200428] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.200840] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-bce06327-09ef-465a-92b5-0e60a3b52cae taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.201804] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.202097] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.203166] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.203818] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce06327-09ef-465a-92b5-0e60a3b52cae',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.499023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.499023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.499880] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.706922] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.707168] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.707302] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.707607] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.707771] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.707994] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port bce06327-09ef-465a-92b5-0e60a3b52cae not found, creating... [ 641.708325] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.708493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.708675] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.708854] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.708996] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.709291] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.709477] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.709618] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.709825] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.709964] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.711428] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: bce06327-09ef-465a-92b5-0e60a3b52cae is going to be created. [ 641.732860] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.733214] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.733293] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.733537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.733831] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.734093] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.004703] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.095755] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 642.095976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.426060] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-9a39bcc0-6c09-4cc3-95d7-61701a8c4b98 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 642.426260] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-9a39bcc0-6c09-4cc3-95d7-61701a8c4b98 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 642.426508] env[64436]: INFO networking_nsxv3.common.synchronization [req-6fb1bd46-f472-4a38-b4bf-449e97efeead req-9a39bcc0-6c09-4cc3-95d7-61701a8c4b98 service nova] Enqueued Resource ID: bce06327-09ef-465a-92b5-0e60a3b52cae with Priority: HIGHEST for action port [ 642.427049] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 642.427183] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 642.427278] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce06327-09ef-465a-92b5-0e60a3b52cae with Priority: HIGHEST for action port [ 642.427546] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.427665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.427856] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.427954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.429077] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-bce06327-09ef-465a-92b5-0e60a3b52cae taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.429077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.429077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.429077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.429077] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce06327-09ef-465a-92b5-0e60a3b52cae',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.508061] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.508273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.508370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.508671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.508767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.508903] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 642.544496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.544881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.545277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.545546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.545723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.555306] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 642.935606] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bce06327-09ef-465a-92b5-0e60a3b52cae with status ACTIVE [ 642.935606] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.935606] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.935606] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.935606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.935606] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bce06327-09ef-465a-92b5-0e60a3b52cae is going to be updated. [ 642.958664] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.958664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.958664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.958664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.958664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.958664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bce06327-09ef-465a-92b5-0e60a3b52cae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.972454] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b in Status: SUCCESS [ 642.974042] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b deletion is rescheduled due to dependency. [ 642.974042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.272514] env[64436]: INFO networking_nsxv3.common.synchronization [None req-0d199e44-f1f6-4f0c-b940-815dcfb1039b None None] Enqueued Resource ID: 1cd0bcd8-8491-4d3f-b2cb-65179f661f2e with Priority: HIGHEST for action port [ 643.272779] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd0bcd8-8491-4d3f-b2cb-65179f661f2e with Priority: HIGHEST for action port [ 643.275696] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cd0bcd8-8491-4d3f-b2cb-65179f661f2e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.275696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cd0bcd8-8491-4d3f-b2cb-65179f661f2e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.275696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cd0bcd8-8491-4d3f-b2cb-65179f661f2e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.275696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cd0bcd8-8491-4d3f-b2cb-65179f661f2e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.275696] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cd0bcd8-8491-4d3f-b2cb-65179f661f2e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.777146] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cd0bcd8-8491-4d3f-b2cb-65179f661f2e [ 643.777417] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.777571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.777670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.778706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.778706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.778706] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cd0bcd8-8491-4d3f-b2cb-65179f661f2e already deleted. [ 643.778706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cd0bcd8-8491-4d3f-b2cb-65179f661f2e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.941847] env[64436]: INFO networking_nsxv3.common.synchronization [None req-05d682b7-fe4a-4eb9-913a-da1b0e6bd556 tempest-ServersTestManualDisk-1492175432 tempest-ServersTestManualDisk-1492175432-project-member] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_rules [ 643.942410] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_rules [ 643.943210] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.943373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.943468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.943778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.945050] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.043539] env[64436]: INFO networking_nsxv3.common.synchronization [None req-52aae21b-b070-4c04-a0ec-a4957e450089 tempest-ServersTestManualDisk-1492175432 tempest-ServersTestManualDisk-1492175432-project-member] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_rules [ 644.043931] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_rules [ 644.044245] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.044371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.466053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.466453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.466507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.466745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.466850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.467011] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 already deleted. [ 644.471022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.471022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.471022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.471022] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.571165] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.571165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.571165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.571165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.571165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.571904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.572052] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.572871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.573093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.573309] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.573374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.573419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.573619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.573669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.573751] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.990384] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.990546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.990546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.992907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.992907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.992907] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 already deleted. [ 644.992907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.005640] env[64436]: INFO networking_nsxv3.common.synchronization [req-3c918189-3b87-4d50-ba30-e6f366e429fa req-a83faafb-f962-4a7a-8fd5-8ba29355e698 tempest-ServersAdminNegativeTestJSON-837803547 tempest-ServersAdminNegativeTestJSON-837803547-project-member] Enqueued Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 645.006274] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7502962-276d-43f0-96f0-2447f12d3137 with Priority: HIGHEST for action security_group_members [ 645.006638] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7502962-276d-43f0-96f0-2447f12d3137 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.006775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.006845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.012127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.012382] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.012516] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.012614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.012850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.012913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.013027] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7502962-276d-43f0-96f0-2447f12d3137',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.075282] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed89fd9-eeee-4f35-9707-895a0fcd48b0: rpc.has_security_group_logging(os_id): False [ 645.079488] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.094271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.094435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.094514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.094775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.094858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.095138] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.095267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.095337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.095501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.095581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.095787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.095880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.095943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.096095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.096168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.096363] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.096468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.096528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.096665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.096738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.096819] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be created. [ 645.154404] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.154404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.154404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.154602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.154746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.165576] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 645.519032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.519032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.519032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.519032] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7502962-276d-43f0-96f0-2447f12d3137 is going to be updated. [ 645.545117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.546612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.546612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.546612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.546612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.554795] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: IN_PROGRESS for 2s [ 645.580372] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.735538] env[64436]: INFO networking_nsxv3.common.synchronization [req-62c69de5-0c8c-4cdd-99c5-827716f05fba req-5670addb-8430-4d3b-a3d5-529b53b3bc0d tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 645.736186] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 645.736711] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.736711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.736845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.737091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.737267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.737378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.737444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.737635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.737747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.738104] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.967022] env[64436]: INFO networking_nsxv3.common.synchronization [None req-5510b12f-0560-4d40-88ad-56ba5f7a6730 None None] Enqueued Resource ID: 75c7822e-a724-4881-a265-e5face057da6 with Priority: HIGHEST for action port [ 645.971213] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c7822e-a724-4881-a265-e5face057da6 with Priority: HIGHEST for action port [ 645.971589] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-75c7822e-a724-4881-a265-e5face057da6 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.971803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75c7822e-a724-4881-a265-e5face057da6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.971844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75c7822e-a724-4881-a265-e5face057da6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.972082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75c7822e-a724-4881-a265-e5face057da6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.972209] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75c7822e-a724-4881-a265-e5face057da6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.065221] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.065302] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.065426] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.065734] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.065986] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.070268] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.070393] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.070635] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.070779] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.071055] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.071391] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.071391] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.071391] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.071770] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.071770] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.071770] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.083998] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.083998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.083998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.084629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.084629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.084629] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 646.089505] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.089505] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 646.089505] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.089505] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.089505] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-a7ab0a27-394e-4943-affc-2d0416413973 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.089505] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.089505] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.091810] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.091810] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ab0a27-394e-4943-affc-2d0416413973',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.120305] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.120460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.120536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.120769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.120908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.131560] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 646.242340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.243680] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.243680] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 already deleted. [ 646.243680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.476053] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75c7822e-a724-4881-a265-e5face057da6 [ 646.476271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.476435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.476905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.476905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.476905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.476905] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75c7822e-a724-4881-a265-e5face057da6 already deleted. [ 646.477045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75c7822e-a724-4881-a265-e5face057da6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.592259] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.592625] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.592625] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.592927] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.593099] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.593268] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port a7ab0a27-394e-4943-affc-2d0416413973 not found, creating... [ 646.593540] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.593702] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.593819] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.594191] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.594295] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.594651] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.594820] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.594940] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.595165] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.595303] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.595455] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: a7ab0a27-394e-4943-affc-2d0416413973 is going to be created. [ 646.615948] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.615948] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.615948] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.615948] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.616182] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.616450] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.177869] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 647.178122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.178297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.178504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.178593] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.304570] env[64436]: INFO networking_nsxv3.common.synchronization [req-62c69de5-0c8c-4cdd-99c5-827716f05fba req-0d131f2a-8c56-425f-9fae-8139bf2fa484 service nova] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 647.304776] env[64436]: INFO networking_nsxv3.common.synchronization [req-62c69de5-0c8c-4cdd-99c5-827716f05fba req-0d131f2a-8c56-425f-9fae-8139bf2fa484 service nova] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 647.304876] env[64436]: INFO networking_nsxv3.common.synchronization [req-62c69de5-0c8c-4cdd-99c5-827716f05fba req-0d131f2a-8c56-425f-9fae-8139bf2fa484 service nova] Enqueued Resource ID: a7ab0a27-394e-4943-affc-2d0416413973 with Priority: HIGHEST for action port [ 647.305125] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 647.305254] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 647.305345] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ab0a27-394e-4943-affc-2d0416413973 with Priority: HIGHEST for action port [ 647.305970] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.306155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.306155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.306290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.306404] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.307506] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.307681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.307681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.307850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.307999] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.308109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.308170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.308311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.308399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.308486] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.309188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7ab0a27-394e-4943-affc-2d0416413973 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.309298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.309364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.309510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.309593] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ab0a27-394e-4943-affc-2d0416413973',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.563628] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7502962-276d-43f0-96f0-2447f12d3137 in Status: SUCCESS [ 647.563628] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7502962-276d-43f0-96f0-2447f12d3137 deletion is rescheduled due to dependency. [ 647.563628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7502962-276d-43f0-96f0-2447f12d3137" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.684977] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.685321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.811444] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.811614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.811839] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.812837] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7ab0a27-394e-4943-affc-2d0416413973 with status ACTIVE [ 647.813052] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.813189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.813263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.813514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.813619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.813811] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.813924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.813998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.814198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.814292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.814552] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.814659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.814761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.814896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.815035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.815112] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7ab0a27-394e-4943-affc-2d0416413973 is going to be updated. [ 647.834765] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.834932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.835050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.835287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.835453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.835655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7ab0a27-394e-4943-affc-2d0416413973" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.140603] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 648.140704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.141292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.141292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.141626] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.141775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.142053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.142053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.142255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.142255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.142351] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.318824] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.525056] env[64436]: INFO networking_nsxv3.common.synchronization [req-fe07fa2b-add4-4238-8710-e25038c191a5 req-2d865d01-3a43-485b-8632-ac799eb44364 tempest-ServerRescueTestJSON-102856840 tempest-ServerRescueTestJSON-102856840-project-member] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 648.526945] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 648.526945] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.526945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.526945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.526945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.526945] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.526945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.527548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.527548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.527548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.527548] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.644409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.644571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.644632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.644856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.645031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.645127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.647014] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.647014] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.647014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.647014] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.792437] env[64436]: INFO networking_nsxv3.common.synchronization [req-eff84efb-6174-401d-a58b-a5783ea5d8ab req-c095b19b-2e33-4912-862e-a5f2e6e51045 tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 648.792923] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 648.793402] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.793530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.793621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.793822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.793974] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.794091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.794315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.794492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.794591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.794684] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.822554] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.822718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.822785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.823022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.823123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.823225] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be created. [ 648.850469] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.850614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.850691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.850909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.851094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.859691] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: UNINITIALIZED for 2s [ 649.029675] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.029904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.029904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.030144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.030215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.030397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.030525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.030593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.030744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.030824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.030910] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 already deleted. [ 649.030992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.114499] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-747 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.114699] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.114824] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.115186] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.115444] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.115603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.115720] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.115939] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.116100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.116312] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.116457] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.116572] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.116680] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.116790] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.116894] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.117028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.134083] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.134240] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.134375] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.134572] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.134847] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-9312005e-ac86-42c8-a242-dc026ded3192 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.135016] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.135142] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.135423] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.135561] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9312005e-ac86-42c8-a242-dc026ded3192',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.148796] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed89fd9-eeee-4f35-9707-895a0fcd48b0: rpc.has_security_group_logging(os_id): False [ 649.165531] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.165690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.165748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.165885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.165974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.166165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.166264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.166355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.166512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.166590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.166786] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.166880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.166944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.167095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.167171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.167342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.167434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.167513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.167677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.167756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.167840] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 649.243201] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.243372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.243434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.243633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.243803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.259446] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 649.296601] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.296753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.296820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.297050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.297142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.297359] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.297452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.297511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.297690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.297784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.297870] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 649.328076] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.328076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.328076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.328284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.328435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.336182] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 649.637748] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.637986] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.638137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.638485] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.638649] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.638804] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 9312005e-ac86-42c8-a242-dc026ded3192 not found, creating... [ 649.639081] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.639242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.639363] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.639763] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.639931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.640247] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.640413] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.640539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.640763] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.640903] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.641058] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 9312005e-ac86-42c8-a242-dc026ded3192 is going to be created. [ 649.661813] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.662092] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.662251] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.662547] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.662803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.663024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.366488] env[64436]: INFO networking_nsxv3.common.synchronization [req-fe07fa2b-add4-4238-8710-e25038c191a5 req-dc1e55f3-0445-4524-b8fe-ca54665d7f37 service nova] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_rules [ 650.366488] env[64436]: INFO networking_nsxv3.common.synchronization [req-fe07fa2b-add4-4238-8710-e25038c191a5 req-dc1e55f3-0445-4524-b8fe-ca54665d7f37 service nova] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 650.366488] env[64436]: INFO networking_nsxv3.common.synchronization [req-fe07fa2b-add4-4238-8710-e25038c191a5 req-dc1e55f3-0445-4524-b8fe-ca54665d7f37 service nova] Enqueued Resource ID: 9312005e-ac86-42c8-a242-dc026ded3192 with Priority: HIGHEST for action port [ 650.366488] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_rules [ 650.366488] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 650.366488] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9312005e-ac86-42c8-a242-dc026ded3192 with Priority: HIGHEST for action port [ 650.366950] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.366950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.366950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.371107] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.371107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.371107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.371107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.371107] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.372196] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-9312005e-ac86-42c8-a242-dc026ded3192 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.372477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.372668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.372909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.373078] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9312005e-ac86-42c8-a242-dc026ded3192',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.871194] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 650.871572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.871841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.872169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.872457] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.872657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.872799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.873570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.873678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.873776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.873878] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.876108] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.876108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.877709] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.879781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9312005e-ac86-42c8-a242-dc026ded3192 with status ACTIVE [ 650.880326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.881270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.881270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.881538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.884337] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.884337] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.884337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.884337] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9312005e-ac86-42c8-a242-dc026ded3192 is going to be updated. [ 650.905040] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.905197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.905257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.905531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.905726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.905931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9312005e-ac86-42c8-a242-dc026ded3192" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.272705] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 651.272923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.346984] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 651.347223] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 deletion is rescheduled due to dependency. [ 651.347338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.376940] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.385044] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.881028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0477e290-dfb6-401d-bc8e-f26e35953b43: rpc.has_security_group_logging(os_id): False [ 651.887092] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.887314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.887530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.887644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.930903] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 is going to be created. [ 651.930903] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.930903] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.930903] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be created. [ 651.930903] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.930903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.932372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.932372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.932372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.932372] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: UNINITIALIZED for 2s [ 651.960237] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.960237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.960237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.960360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.960462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.970050] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 653.932604] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: SUCCESS [ 653.932840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.932993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.933244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.933421] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.933521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.933590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.933737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.933819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.933903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.933992] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.981291] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 653.981528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.437763] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.438011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.438147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.438394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.438572] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.438719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.438824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.438930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.439047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.439142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.439287] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.439377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.439432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.440313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.440313] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.440550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.440633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.440787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.440867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.440953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.441053] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.945568] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e04160bc-db4b-4c32-8c62-3a41769c7c95: rpc.has_security_group_logging(os_id): False [ 654.967476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.967476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.967476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.967682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.967761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.967954] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.968079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.968143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.968307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.968389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.968598] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.968682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.968725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.968977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.968977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.969094] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.969194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.969255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.969395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.969473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.969557] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 is going to be created. [ 655.028872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.030258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.030258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.030258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.030258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.041038] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: IN_PROGRESS for 2s [ 655.368105] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 655.368202] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 655.886099] env[64436]: INFO networking_nsxv3.common.synchronization [req-dfa6b47a-7b89-405d-82be-e1e3ebd0a3a1 req-0ac47807-097c-4179-9fc9-42a7fcf0350e tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 655.887329] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 655.887329] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.887329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.887329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.887329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.887669] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.887669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.887669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.887830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.887916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.890254] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.945078] env[64436]: INFO networking_nsxv3.common.synchronization [req-b37b49b0-1d3d-4fd9-81d3-26aa5b289ca9 req-d4fc99ab-4a0c-424e-8d1f-8df5b90ab4ec tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 655.945470] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 655.945855] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.946140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.392414] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.673994] env[64436]: INFO networking_nsxv3.common.synchronization [req-97e5c8b2-b42f-4da7-974d-b49e8b45a437 req-3025459e-4a25-4116-8272-edac9db17762 tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 656.674413] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 656.674723] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.674845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.674915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.675135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.675548] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.675548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.675548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.675700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.675700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.675760] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.894501] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.050111] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.050973] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.051247] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.051610] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.052143] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.052619] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.052864] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.053198] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.054230] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.054596] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.056634] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.056926] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.056926] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.057073] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.057129] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.057261] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.058947] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: SUCCESS [ 657.059164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.075557] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.075771] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.075926] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.076134] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.076613] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-7b6069b5-efbe-43aa-8f44-5a160cf277b2 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.076807] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.076987] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.077538] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.077857] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b6069b5-efbe-43aa-8f44-5a160cf277b2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.179958] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.404028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.404028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.404028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.404028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.404028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.404028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 657.434220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.434220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.434220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.434220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.434220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.441188] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 657.580057] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.581102] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.581343] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.581820] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.581919] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.582391] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 7b6069b5-efbe-43aa-8f44-5a160cf277b2 not found, creating... [ 657.582744] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.582966] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.583425] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.583729] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.583907] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.584308] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.584521] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.584682] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.584874] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.585224] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.585474] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 7b6069b5-efbe-43aa-8f44-5a160cf277b2 is going to be created. [ 657.604817] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.605181] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 657.605606] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.605606] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.605887] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.606039] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.681909] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.185048] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.185415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.185415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.185520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.185579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.185675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 658.216034] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.216183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.216259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.216517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.216672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.226637] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 658.303969] env[64436]: INFO networking_nsxv3.common.synchronization [req-97e5c8b2-b42f-4da7-974d-b49e8b45a437 req-f68e3309-00d2-4e8c-a0fa-7603e6b5759a service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 658.304171] env[64436]: INFO networking_nsxv3.common.synchronization [req-97e5c8b2-b42f-4da7-974d-b49e8b45a437 req-f68e3309-00d2-4e8c-a0fa-7603e6b5759a service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 658.304310] env[64436]: INFO networking_nsxv3.common.synchronization [req-97e5c8b2-b42f-4da7-974d-b49e8b45a437 req-f68e3309-00d2-4e8c-a0fa-7603e6b5759a service nova] Enqueued Resource ID: 7b6069b5-efbe-43aa-8f44-5a160cf277b2 with Priority: HIGHEST for action port [ 658.306423] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 658.306423] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 658.306423] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b6069b5-efbe-43aa-8f44-5a160cf277b2 with Priority: HIGHEST for action port [ 658.306423] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.306423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.306423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.306423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.306423] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.306916] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.306916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.307023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b6069b5-efbe-43aa-8f44-5a160cf277b2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.308216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.308314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.308461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.308599] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b6069b5-efbe-43aa-8f44-5a160cf277b2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.809981] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.810155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.812557] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b6069b5-efbe-43aa-8f44-5a160cf277b2 with status ACTIVE [ 658.812777] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.812983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.813117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.813352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.813450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.813961] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.813961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.813961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.813961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.814185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.814220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.814351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.814351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.814517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.814589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.814678] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b6069b5-efbe-43aa-8f44-5a160cf277b2 is going to be updated. [ 658.836234] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.836401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.836401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.836645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.836777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.836930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b6069b5-efbe-43aa-8f44-5a160cf277b2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.450451] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 659.450724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.450900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.451129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.453958] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.454158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.454158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.454614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.454614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.454614] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.956652] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.956871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.956924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.957131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.957230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.957428] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.958069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.958171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.958344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.958430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.958520] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 659.983362] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.983479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.983553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.983759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.983912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.992323] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 660.237034] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 660.237262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.237427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.237778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.237977] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.238136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.238303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.238389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.238489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.238603] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.741669] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.243198] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.710777] env[64436]: INFO networking_nsxv3.common.synchronization [req-40f44eb1-4a2c-4ee7-bd0c-fbef20855bbc req-67e4b524-8b9c-4685-8145-1250e9892b26 tempest-ServersNegativeTestJSON-1058932887 tempest-ServersNegativeTestJSON-1058932887-project-member] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 661.710777] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 661.710777] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.710777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.710777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.710777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.711030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.711030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.711030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.714972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.715088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.715187] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.717368] env[64436]: INFO networking_nsxv3.common.synchronization [req-482aaadf-7eef-4c01-8624-fb297ea1f22c req-796cbf52-8806-417c-a5b4-e80de3931d1e tempest-FloatingIPsAssociationTestJSON-1278161632 tempest-FloatingIPsAssociationTestJSON-1278161632-project-member] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 661.717779] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGHEST for action security_group_members [ 661.720356] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.720356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.720356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.720356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.720356] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.720356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.720356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.720356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.720356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.720356] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.745844] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.745844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.745844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.746259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.746259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.746259] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 661.774115] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.775074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.775154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.775349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.775495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.784029] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 662.000831] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 662.001016] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 deletion is rescheduled due to dependency. [ 662.001148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.056860] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.056989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.057035] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.057424] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.057782] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.057936] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.058068] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.058319] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.058470] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.058683] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.058801] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.058910] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.059030] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.059144] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.059249] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.059379] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.074823] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.075238] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.075383] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.075546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.075820] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-51db4609-051d-4b6c-8455-b2276d12c133 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.075980] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.076111] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.076385] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.076567] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51db4609-051d-4b6c-8455-b2276d12c133',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.219143] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.219383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.219521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.219726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.219853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.220124] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.220264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.220344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.220547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.220646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.220735] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 already deleted. [ 662.220818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.222658] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.222806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.222877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.223096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.223218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.223403] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.223539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.223615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.223795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.223898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.223995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be updated. [ 662.259579] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.259757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.259799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.260079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.260263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.268216] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: IN_PROGRESS for 2s [ 662.578569] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.578915] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.579104] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.579390] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.579546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.579704] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 51db4609-051d-4b6c-8455-b2276d12c133 not found, creating... [ 662.579964] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.580144] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.580262] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.580491] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.580630] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.581203] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.581203] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.581203] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.581437] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.581514] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.581653] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 51db4609-051d-4b6c-8455-b2276d12c133 is going to be created. [ 662.605624] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.605842] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.605994] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.606329] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.606617] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.606851] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.295406] env[64436]: INFO networking_nsxv3.common.synchronization [req-40f44eb1-4a2c-4ee7-bd0c-fbef20855bbc req-e5fd3c9a-7c76-4a82-9e0b-73ed1bf01b62 service nova] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_rules [ 663.295732] env[64436]: INFO networking_nsxv3.common.synchronization [req-40f44eb1-4a2c-4ee7-bd0c-fbef20855bbc req-e5fd3c9a-7c76-4a82-9e0b-73ed1bf01b62 service nova] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 663.295732] env[64436]: INFO networking_nsxv3.common.synchronization [req-40f44eb1-4a2c-4ee7-bd0c-fbef20855bbc req-e5fd3c9a-7c76-4a82-9e0b-73ed1bf01b62 service nova] Enqueued Resource ID: 51db4609-051d-4b6c-8455-b2276d12c133 with Priority: HIGHEST for action port [ 663.295942] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_rules [ 663.296110] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 663.296191] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51db4609-051d-4b6c-8455-b2276d12c133 with Priority: HIGHEST for action port [ 663.297186] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.297324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.297387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.297661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.297735] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.298576] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.298681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.298752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.298945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.299116] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.299214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.299278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.299423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.299512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.299600] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.300324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-51db4609-051d-4b6c-8455-b2276d12c133 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.300431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.300499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.300652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.300727] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51db4609-051d-4b6c-8455-b2276d12c133',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.794534] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 663.794782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.794954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.795185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.795379] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.795506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.795602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.795725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.795807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.795892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.795980] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.802715] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.802842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.802978] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.803726] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51db4609-051d-4b6c-8455-b2276d12c133 with status ACTIVE [ 663.803902] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.804028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.804095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.804241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.804318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.805046] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.805046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.805046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.805046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.805046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.805324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.805324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.805324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.805440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.805515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.805608] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51db4609-051d-4b6c-8455-b2276d12c133 is going to be updated. [ 663.827619] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.827828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.827912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.828202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.828360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.828527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.277660] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 in Status: SUCCESS [ 664.277933] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 deletion is rescheduled due to dependency. [ 664.278102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.298733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.299138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.299138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.299213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.299370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.299478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.299542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.299719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.299813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.299900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.300413] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.300413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.300413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.300413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.300578] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.300578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.300649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.300757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.300801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.300876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.300965] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.307817] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.803582] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeeb0085-3d91-4859-b6e8-d553406b2219: rpc.has_security_group_logging(os_id): False [ 664.811625] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.811625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.811625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.811625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.811625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.811625] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be created. [ 664.826019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.826019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.826019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.826019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.826707] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.826707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.826707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.826707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.826707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.826707] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 664.844398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.844398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.844398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.844398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.844398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.854577] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: UNINITIALIZED for 2s [ 664.903923] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.904592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.904802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.906711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.906711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.920998] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 666.864878] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 666.865297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.865374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.865584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.865779] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.865902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.865969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.866148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.866234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.866322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.866413] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.935506] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 666.935689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.159113] env[64436]: INFO networking_nsxv3.common.synchronization [req-2c3d84b4-ee38-423f-8c97-28a75990e930 req-acf72b69-3c53-40e6-ab9e-9809df249e59 tempest-ServerGroupTestJSON-905228257 tempest-ServerGroupTestJSON-905228257-project-member] Enqueued Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_members [ 667.160161] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_members [ 667.160372] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ef4caa-55e7-4f89-9577-78cea5744bdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.160490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.160560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.160822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.160988] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.161126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.161187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.161347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.161434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.161527] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.370845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.370845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.370845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.370845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.370845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.370845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.370845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.370845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.370845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.371258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.371258] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.371258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.371258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.371388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.371429] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.371522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.371585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.371748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.371788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.371868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.371979] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.436538] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.436793] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-882" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.436921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-882" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.437294] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-882" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.437597] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.437722] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.437842] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.438102] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.438502] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.438502] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.438597] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.438672] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.438777] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.438885] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.438988] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.439158] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.457974] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.457974] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.458127] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.458300] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-882" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.458609] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.458780] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.458918] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.459207] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.459343] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d112bec5-1cc1-4b60-a4e7-9ee472237a6b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.663948] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.664131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.664192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.664405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.664501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.664732] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.664837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.664902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.665074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.665147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.665275] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb already deleted. [ 667.665374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.874420] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 377c820a-e6ee-48bb-9450-abc7d40a08d0: rpc.has_security_group_logging(os_id): False [ 667.892222] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.892977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.892977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.893120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.893196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.893402] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.893546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.893595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.893713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.894046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.894280] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.894380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.894445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.894701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.894788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.894981] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.895094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.895156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.895297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.895372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.895456] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be created. [ 667.950134] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.950373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.950438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.950635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.950877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.960384] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 667.962050] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.962271] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.962461] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.962747] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.962918] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.963178] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d112bec5-1cc1-4b60-a4e7-9ee472237a6b not found, creating... [ 667.963465] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.963669] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.963814] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.964112] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.964283] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.964618] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.964782] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.964982] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.965246] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.965389] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.965553] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d112bec5-1cc1-4b60-a4e7-9ee472237a6b is going to be created. [ 667.983328] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.983643] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.983786] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.984118] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.984365] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.984651] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.789203] env[64436]: INFO networking_nsxv3.common.synchronization [req-ccaa46ec-8e66-4753-bc8a-ff24f5b30b67 req-c6f4c6c9-697a-461e-a5ae-aabfdb078390 tempest-InstanceActionsNegativeTestJSON-1895992846 tempest-InstanceActionsNegativeTestJSON-1895992846-project-member] Enqueued Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_members [ 668.789740] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_members [ 668.792036] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.792036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.792036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.792036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.792036] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.792036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.792036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.792036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.792036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.795272] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.876545] env[64436]: INFO networking_nsxv3.common.synchronization [req-2c3d84b4-ee38-423f-8c97-28a75990e930 req-e0cb2f00-4925-4f19-8542-9574d4ad9982 service nova] Enqueued Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_rules [ 668.876819] env[64436]: INFO networking_nsxv3.common.synchronization [req-2c3d84b4-ee38-423f-8c97-28a75990e930 req-e0cb2f00-4925-4f19-8542-9574d4ad9982 service nova] Enqueued Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_members [ 668.876890] env[64436]: INFO networking_nsxv3.common.synchronization [req-2c3d84b4-ee38-423f-8c97-28a75990e930 req-e0cb2f00-4925-4f19-8542-9574d4ad9982 service nova] Enqueued Resource ID: d112bec5-1cc1-4b60-a4e7-9ee472237a6b with Priority: HIGHEST for action port [ 668.877129] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_rules [ 668.877260] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_members [ 668.877356] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d112bec5-1cc1-4b60-a4e7-9ee472237a6b with Priority: HIGHEST for action port [ 668.877880] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ef4caa-55e7-4f89-9577-78cea5744bdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.878017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.878090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.878336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.878445] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.879648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ef4caa-55e7-4f89-9577-78cea5744bdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.879769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.879840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.880016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.880167] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.880264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.880329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.880479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.880567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.880654] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.881353] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.881461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.881531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.882080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.882169] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d112bec5-1cc1-4b60-a4e7-9ee472237a6b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.111872] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-874 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.111872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-874" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.111872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-874" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.111872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-874" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.111872] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.111872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.111872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.112245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.112280] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.112511] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.112742] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.112862] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.112969] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.113094] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.113202] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.113331] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.132158] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.132394] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.132475] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.132648] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-874" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.133660] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.133855] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.133981] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.134308] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.134453] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3146f3-4ea1-44ec-b7f0-b1477a3976d5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.299724] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.299877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.300078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.300183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.300277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.300479] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.300579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.300644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.300797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.300875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.300972] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9265bbca-5d7b-479b-bdda-7812d116a191 already deleted. [ 669.301125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.380884] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ef4caa-55e7-4f89-9577-78cea5744bdb taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.381036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.383698] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.387408] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d112bec5-1cc1-4b60-a4e7-9ee472237a6b with status ACTIVE [ 669.387859] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.388075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.388075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.388305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.388419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.388556] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.388651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.388712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.388857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.388970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.389342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.389342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.389342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.389475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.389549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.391527] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d112bec5-1cc1-4b60-a4e7-9ee472237a6b is going to be updated. [ 669.409362] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.409545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.409545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.409756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.409889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.410376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d112bec5-1cc1-4b60-a4e7-9ee472237a6b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.637272] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.638425] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.638425] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.638425] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.638591] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.638704] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 not found, creating... [ 669.638938] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.639126] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.639318] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.639569] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.639749] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.640095] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.640328] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.640472] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.640633] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.640796] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.640939] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 is going to be created. [ 669.664069] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.664302] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.664431] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.664731] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.664967] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.665211] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.886242] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.973310] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 669.973540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.354520] env[64436]: INFO networking_nsxv3.common.synchronization [req-ccaa46ec-8e66-4753-bc8a-ff24f5b30b67 req-a0289e8b-46ba-47ba-aeec-3cee97418c50 service nova] Enqueued Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_rules [ 670.354520] env[64436]: INFO networking_nsxv3.common.synchronization [req-ccaa46ec-8e66-4753-bc8a-ff24f5b30b67 req-a0289e8b-46ba-47ba-aeec-3cee97418c50 service nova] Enqueued Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_members [ 670.354722] env[64436]: INFO networking_nsxv3.common.synchronization [req-ccaa46ec-8e66-4753-bc8a-ff24f5b30b67 req-a0289e8b-46ba-47ba-aeec-3cee97418c50 service nova] Enqueued Resource ID: 4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 with Priority: HIGHEST for action port [ 670.354889] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_rules [ 670.355028] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_members [ 670.355131] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 with Priority: HIGHEST for action port [ 670.355694] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.355881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.355881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.356156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.356240] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.357113] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.357239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.357308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.357472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.357617] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.357707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.357785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.357937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.358017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.358102] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.359198] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.359304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.359374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.359523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.359605] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3146f3-4ea1-44ec-b7f0-b1477a3976d5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.388533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.388785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.388785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.388973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.389078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.389179] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb is going to be created. [ 670.412205] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.412365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.412426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.412596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.412793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.421693] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb in Status: UNINITIALIZED for 2s [ 670.862031] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.863019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.863019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.865373] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 with status ACTIVE [ 670.865373] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.865373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.865373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.865373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.865373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.865373] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.865858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.865858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.865858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.865858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.865991] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.866085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.866124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.866364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.866364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.866454] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c3146f3-4ea1-44ec-b7f0-b1477a3976d5 is going to be updated. [ 670.885622] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.885817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.885896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.886119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.886258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.886514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c3146f3-4ea1-44ec-b7f0-b1477a3976d5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.364117] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.866222] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.866395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.866470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.866746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.866844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.866946] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9265bbca-5d7b-479b-bdda-7812d116a191 is going to be created. [ 671.888365] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.888680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.888680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.888753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.888912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.897458] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9265bbca-5d7b-479b-bdda-7812d116a191 in Status: UNINITIALIZED for 2s [ 672.430965] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb in Status: SUCCESS [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.434009] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.434009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.434009] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.935550] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ef4caa-55e7-4f89-9577-78cea5744bdb taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.935940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.935940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.936050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.936184] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.936295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.936401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.936586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.936586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.936737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.936896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ef4caa-55e7-4f89-9577-78cea5744bdb taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.936989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.937081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.937206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.937342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.937433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.937494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.937639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.937777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.937873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.937964] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.439795] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9ef4caa-55e7-4f89-9577-78cea5744bdb: rpc.has_security_group_logging(os_id): False [ 673.457489] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.457691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.457793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.458468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.458468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.458468] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.458668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.458668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.458970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.458970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.459120] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.459244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.459367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.459497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.459595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.459805] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.459946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.459986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.460138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.460244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.460340] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb is going to be created. [ 673.518933] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.519112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.519197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.519439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.519629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.529817] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb in Status: IN_PROGRESS for 2s [ 673.906210] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9265bbca-5d7b-479b-bdda-7812d116a191 in Status: SUCCESS [ 673.906430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.906590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.906846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.907036] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.907157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.907223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.907379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.907581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.907581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.907719] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.410163] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.410562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.410562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.410765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.410942] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.411082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.411159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.411337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.411441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.411542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.411717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.411817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.411896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.412078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.412250] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.412359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.412422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.412575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.412667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.412759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.412879] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.915565] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9265bbca-5d7b-479b-bdda-7812d116a191: rpc.has_security_group_logging(os_id): False [ 674.933162] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.933315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.933388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.933604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.933735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.933957] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.934077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.934143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.934315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.934397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.934663] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.934771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.934837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.934982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.935072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.935264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.935379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.935441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.935584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.935659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 674.935745] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9265bbca-5d7b-479b-bdda-7812d116a191 is going to be created. [ 674.993863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.994042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 674.994116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.994334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 674.994529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.017476] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9265bbca-5d7b-479b-bdda-7812d116a191 in Status: IN_PROGRESS for 2s [ 675.356579] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 675.356579] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 675.542809] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb in Status: SUCCESS [ 675.542809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.031550] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9265bbca-5d7b-479b-bdda-7812d116a191 in Status: SUCCESS [ 677.031872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.357892] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 680.357892] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 680.427075] env[64436]: INFO networking_nsxv3.common.synchronization [req-07f3504f-2382-4c77-a44b-13f4135245e8 req-a4ceefe1-b786-4576-9698-3aa6ca748fa5 tempest-InstanceActionsNegativeTestJSON-1895992846 tempest-InstanceActionsNegativeTestJSON-1895992846-project-member] Enqueued Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_members [ 680.427642] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGHEST for action security_group_members [ 680.427953] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.428089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.428183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.428390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.428580] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.428688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.428747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.429162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.429162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.429162] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.777511] env[64436]: INFO networking_nsxv3.common.synchronization [req-075c95a1-93dc-40b3-b0b9-5491b687e777 req-d38e46d5-ac71-4397-bb25-ef030f7e8909 tempest-ServerGroupTestJSON-905228257 tempest-ServerGroupTestJSON-905228257-project-member] Enqueued Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_members [ 680.777511] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb with Priority: HIGHEST for action security_group_members [ 680.777511] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ef4caa-55e7-4f89-9577-78cea5744bdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.777629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.778225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.778225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.778225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.778225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.778225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.778464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.778464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.778518] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ef4caa-55e7-4f89-9577-78cea5744bdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.931643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.931866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.931866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.932097] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.932199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.932420] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.932530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.932588] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.932742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.932819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.932899] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9265bbca-5d7b-479b-bdda-7812d116a191 is going to be updated. [ 680.962161] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.962161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.962161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.962161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.962161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.969100] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9265bbca-5d7b-479b-bdda-7812d116a191 in Status: IN_PROGRESS for 2s [ 681.280124] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.280290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.280364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.280582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.280678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.280879] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.280980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.281055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.281206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.281280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.281384] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb is going to be updated. [ 681.312178] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.312316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.312386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.312601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.312784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.322448] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb in Status: IN_PROGRESS for 2s [ 682.022648] env[64436]: INFO networking_nsxv3.common.synchronization [req-bc8dd442-7f9d-4056-8d8c-9bc7d08889b5 req-eb6bdd21-98b4-4b9a-bdc8-2d3c310ae9e3 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 682.022908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 682.023149] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.023290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.023358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.023579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.023656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.023778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.023818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.023953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.024049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.024142] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.368653] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.368846] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.368965] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.369244] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.369584] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.369672] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.369791] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.370833] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.370833] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.370833] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.370833] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.370833] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.370833] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.371162] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.371162] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.371162] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.387679] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.387843] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.387983] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.388171] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-909" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.388460] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-3ebe78e0-81cc-40e3-9299-2295affb5926 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.388629] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.388749] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.389078] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.389248] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ebe78e0-81cc-40e3-9299-2295affb5926',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.525927] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.891337] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.893020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.893020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.893020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.893020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.893020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 3ebe78e0-81cc-40e3-9299-2295affb5926 not found, creating... [ 682.893020] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.893020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.893020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.893521] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.893521] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.893521] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.893623] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.896231] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.896231] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.896231] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.896231] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 is going to be created. [ 682.914478] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.914701] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.914852] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.915140] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.915369] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.915590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.984495] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9265bbca-5d7b-479b-bdda-7812d116a191 in Status: SUCCESS [ 682.984645] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9265bbca-5d7b-479b-bdda-7812d116a191 deletion is rescheduled due to dependency. [ 682.985378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.028321] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.330943] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb in Status: SUCCESS [ 683.331161] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ef4caa-55e7-4f89-9577-78cea5744bdb deletion is rescheduled due to dependency. [ 683.331275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ef4caa-55e7-4f89-9577-78cea5744bdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.531041] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.531426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.531503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.531786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.531961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.532145] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 683.559083] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.559243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.559319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.560318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.560318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.571566] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 683.598027] env[64436]: INFO networking_nsxv3.common.synchronization [req-bc8dd442-7f9d-4056-8d8c-9bc7d08889b5 req-60c6070e-fdb8-4c27-b0b3-87dd8001138a service nova] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 683.598277] env[64436]: INFO networking_nsxv3.common.synchronization [req-bc8dd442-7f9d-4056-8d8c-9bc7d08889b5 req-60c6070e-fdb8-4c27-b0b3-87dd8001138a service nova] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 683.598476] env[64436]: INFO networking_nsxv3.common.synchronization [req-bc8dd442-7f9d-4056-8d8c-9bc7d08889b5 req-60c6070e-fdb8-4c27-b0b3-87dd8001138a service nova] Enqueued Resource ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 with Priority: HIGHEST for action port [ 683.599010] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 683.599158] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 683.599259] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 with Priority: HIGHEST for action port [ 683.599530] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.599641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.599715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.599914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.599998] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.601743] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.601858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.602091] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ebe78e0-81cc-40e3-9299-2295affb5926 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.602332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.602426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.602842] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ebe78e0-81cc-40e3-9299-2295affb5926',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.104508] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.104801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.106074] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ebe78e0-81cc-40e3-9299-2295affb5926 with status ACTIVE [ 684.107600] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.107600] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.107600] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.107600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.108209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.108209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.108209] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 is going to be updated. [ 684.128165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.128280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.128353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.128522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.128651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.128811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.582484] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 685.584610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.584610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.584610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.584610] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.584610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.584610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.584610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.584610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.584610] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.086344] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.588676] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.091283] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.091283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.091283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.091484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.091594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.091594] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 687.118753] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.118913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.119014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.119732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.119732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.130171] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 687.250344] env[64436]: INFO networking_nsxv3.common.synchronization [req-d950b583-c0d8-4449-8581-90bc45bc224c req-16b996d8-5398-4ce2-98ca-f69dc9b7ca5f tempest-ServersTestBootFromVolume-1864235061 tempest-ServersTestBootFromVolume-1864235061-project-member] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_members [ 687.251826] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_members [ 687.251826] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.251826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.251826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.251826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.251826] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.251826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.252176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.252788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.252912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.253018] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.621829] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.623055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-537" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.623055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-537" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.623055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-537" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.623055] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.623055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.623055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.623407] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.623441] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.623694] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.623769] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.623884] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.624014] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.624133] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.624256] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.624421] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.641640] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.641820] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.641977] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.642228] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-537" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.642486] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-5a3edbc0-a37d-4f19-bb30-baec17567464 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.642690] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.642819] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.643268] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.643460] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a3edbc0-a37d-4f19-bb30-baec17567464',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.755251] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.755420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.755529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.755816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.755952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.756228] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.756363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.756451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.756663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.756839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.756898] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 already deleted. [ 687.757821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.145842] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.146131] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.146265] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.146625] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.146833] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.146987] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 5a3edbc0-a37d-4f19-bb30-baec17567464 not found, creating... [ 688.147368] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.147557] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.147750] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.147949] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.148124] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.148426] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.148600] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.148723] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.148956] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.149122] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.149263] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 5a3edbc0-a37d-4f19-bb30-baec17567464 is going to be created. [ 688.168478] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.168686] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.168815] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.169141] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.169487] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.169610] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.876372] env[64436]: INFO networking_nsxv3.common.synchronization [req-d950b583-c0d8-4449-8581-90bc45bc224c req-591ac58d-8e3b-46d8-a209-79b7d3437d23 service nova] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_rules [ 688.876689] env[64436]: INFO networking_nsxv3.common.synchronization [req-d950b583-c0d8-4449-8581-90bc45bc224c req-591ac58d-8e3b-46d8-a209-79b7d3437d23 service nova] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_members [ 688.876952] env[64436]: INFO networking_nsxv3.common.synchronization [req-d950b583-c0d8-4449-8581-90bc45bc224c req-591ac58d-8e3b-46d8-a209-79b7d3437d23 service nova] Enqueued Resource ID: 5a3edbc0-a37d-4f19-bb30-baec17567464 with Priority: HIGHEST for action port [ 688.877849] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_rules [ 688.878535] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_members [ 688.878701] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3edbc0-a37d-4f19-bb30-baec17567464 with Priority: HIGHEST for action port [ 688.883325] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.883325] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.883325] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.883325] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.883325] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.883325] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a3edbc0-a37d-4f19-bb30-baec17567464 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.883325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.884082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.885245] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a3edbc0-a37d-4f19-bb30-baec17567464',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.140219] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 689.140458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.140732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.140851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.141074] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.141204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.141272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.141442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.141525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.141621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.141710] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.388116] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a3edbc0-a37d-4f19-bb30-baec17567464 with status ACTIVE [ 689.391952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.391952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.391952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.391952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.391952] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a3edbc0-a37d-4f19-bb30-baec17567464 is going to be updated. [ 689.392629] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.392629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.392629] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.414487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.414643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.415365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.415365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.415365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.415365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a3edbc0-a37d-4f19-bb30-baec17567464" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.648571] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.648768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.648836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.649099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.649303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.649409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.649471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.649629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.649716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.649801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.649945] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.650046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.652363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.652363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.652363] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.652363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.652363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.652363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.652363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.652363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 689.652363] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.691632] env[64436]: INFO networking_nsxv3.common.synchronization [None req-fbecf762-4d46-456c-9ade-79c025ae7a7a None None] Enqueued Resource ID: 174e9d89-df95-4a3f-84fc-8dfc82ab2f51 with Priority: HIGHEST for action port [ 689.691896] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 174e9d89-df95-4a3f-84fc-8dfc82ab2f51 with Priority: HIGHEST for action port [ 689.692648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-174e9d89-df95-4a3f-84fc-8dfc82ab2f51 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.692648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-174e9d89-df95-4a3f-84fc-8dfc82ab2f51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 689.692648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-174e9d89-df95-4a3f-84fc-8dfc82ab2f51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.693039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-174e9d89-df95-4a3f-84fc-8dfc82ab2f51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 689.693039] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('174e9d89-df95-4a3f-84fc-8dfc82ab2f51',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.896959] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.071796] env[64436]: INFO networking_nsxv3.common.synchronization [req-327cb679-c046-42bd-8674-3bef0e7c393d req-38ab7800-1412-4f3c-9588-28e34d0767f6 tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 690.072347] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 690.072652] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.072776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.072846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.073240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.073402] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.073707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.073707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.073707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.073838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.073886] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.154841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9741d578-5b29-42b0-b0b6-dfd97b1c7306: rpc.has_security_group_logging(os_id): False [ 690.172226] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.172326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.172403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.172609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.172698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.172887] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.173032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.173086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.173231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.173267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.173455] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.173546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.173768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.173768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.173822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.174062] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.174167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.174227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.174365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.174439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.174521] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 690.196945] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 174e9d89-df95-4a3f-84fc-8dfc82ab2f51 [ 690.197239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.197375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.197441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.197697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.197932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.197932] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:174e9d89-df95-4a3f-84fc-8dfc82ab2f51 already deleted. [ 690.198059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-174e9d89-df95-4a3f-84fc-8dfc82ab2f51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.239280] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.242503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.242503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.242503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.242503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.253368] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 690.400204] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.400397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.400459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.400756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.400802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.400927] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 is going to be created. [ 690.424124] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.424212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.424283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.424482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.424667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.434382] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: UNINITIALIZED for 2s [ 690.479685] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.479685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.479685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.479685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.479868] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.479932] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.482243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.482243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.482243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.482243] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.482243] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.482243] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.482243] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.482243] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.482758] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.482758] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.500995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.501134] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.501407] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.502111] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.502111] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-6036e44c-ce8a-48be-9870-1e4aaafff70b taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.502111] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.502292] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.503597] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.503597] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6036e44c-ce8a-48be-9870-1e4aaafff70b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.576458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.576458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.576458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.577468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.577468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.577468] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.577468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.577468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.577468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.577468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.577685] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a already deleted. [ 690.577685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.005275] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.005574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.005662] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.005909] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.006069] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.006225] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 6036e44c-ce8a-48be-9870-1e4aaafff70b not found, creating... [ 691.006484] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.006634] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.006756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.007079] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.007227] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.007515] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.007697] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.007838] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.008327] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.008529] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.008712] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 6036e44c-ce8a-48be-9870-1e4aaafff70b is going to be created. [ 691.030094] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.030359] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.031127] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.031127] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.031127] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.031245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.892340] env[64436]: INFO networking_nsxv3.common.synchronization [req-327cb679-c046-42bd-8674-3bef0e7c393d req-f64208db-bd88-4ff5-b98c-b8b8843fbdaa service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 691.892565] env[64436]: INFO networking_nsxv3.common.synchronization [req-327cb679-c046-42bd-8674-3bef0e7c393d req-f64208db-bd88-4ff5-b98c-b8b8843fbdaa service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 691.892701] env[64436]: INFO networking_nsxv3.common.synchronization [req-327cb679-c046-42bd-8674-3bef0e7c393d req-f64208db-bd88-4ff5-b98c-b8b8843fbdaa service nova] Enqueued Resource ID: 6036e44c-ce8a-48be-9870-1e4aaafff70b with Priority: HIGHEST for action port [ 691.893286] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 691.895040] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 691.895040] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6036e44c-ce8a-48be-9870-1e4aaafff70b with Priority: HIGHEST for action port [ 691.895040] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.895040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.895040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.895040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.895040] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.895421] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.895421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.895421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.895421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.896031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.896031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.896031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.896031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.896031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.896031] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.896805] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6036e44c-ce8a-48be-9870-1e4aaafff70b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.896948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.897979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.897979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.897979] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6036e44c-ce8a-48be-9870-1e4aaafff70b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.266607] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 692.266999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.320639] env[64436]: INFO networking_nsxv3.common.synchronization [None req-bbcbe0bd-cc44-4539-ad19-17d93ead394f None None] Enqueued Resource ID: dec8b66b-580f-4fff-97b1-8626a845c735 with Priority: HIGHEST for action port [ 692.321387] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec8b66b-580f-4fff-97b1-8626a845c735 with Priority: HIGHEST for action port [ 692.321962] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-dec8b66b-580f-4fff-97b1-8626a845c735 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.322282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dec8b66b-580f-4fff-97b1-8626a845c735" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.322602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dec8b66b-580f-4fff-97b1-8626a845c735" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.323747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dec8b66b-580f-4fff-97b1-8626a845c735" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.323747] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dec8b66b-580f-4fff-97b1-8626a845c735',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.400079] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6036e44c-ce8a-48be-9870-1e4aaafff70b with status ACTIVE [ 692.400414] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.400618] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.400699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.400920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.401076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.401225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.401328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.401394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.401549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.401631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.401812] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.401909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.401975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.402197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.402197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.402285] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6036e44c-ce8a-48be-9870-1e4aaafff70b is going to be updated. [ 692.403492] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.403623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.403740] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.426442] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.426635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.426697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.426911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.427072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.427248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6036e44c-ce8a-48be-9870-1e4aaafff70b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.451074] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: SUCCESS [ 692.451302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.452035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.452128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.452259] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.455020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.455020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.455020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.455020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.455020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.455020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.805951] env[64436]: INFO networking_nsxv3.common.synchronization [req-75ea17db-87df-43f2-bba6-ac4bb87e694a req-93599302-5b51-462d-a8b3-849a5ad32245 tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 692.805951] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 692.805951] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.805951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.805951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.807028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.809101] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.809101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.810239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.811763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.811763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.811763] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.826937] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dec8b66b-580f-4fff-97b1-8626a845c735 [ 692.826937] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.826937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.826937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.826937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.826937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.826937] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dec8b66b-580f-4fff-97b1-8626a845c735 already deleted. [ 692.826937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dec8b66b-580f-4fff-97b1-8626a845c735" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.908895] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.959020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.245655] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.245864] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.245991] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.246287] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.247258] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.247443] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.247573] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.247828] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.248047] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.248323] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.248446] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.248586] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.248657] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.248807] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.248877] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.249025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.271247] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.271520] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.271562] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.271741] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.272483] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-e61064ad-5de8-494e-9c9b-461a748ce2b3 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.272483] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.272665] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.273991] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.273991] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e61064ad-5de8-494e-9c9b-461a748ce2b3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.313214] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.313405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.313405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.313675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.313855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.314070] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.314211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.314300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.314496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.314591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.314689] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be updated. [ 693.341312] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.341460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.341568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.341764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.341885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.351076] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 693.413539] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.413539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.413659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.413847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.413942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.414055] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be created. [ 693.435837] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.435837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.435837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.436017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.436912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.444971] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: UNINITIALIZED for 2s [ 693.460476] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f1116-13ef-448f-a7e6-f12ab165da73: rpc.has_security_group_logging(os_id): False [ 693.478269] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.478445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.478607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.478805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.478900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.479171] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.479294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.479363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.479524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.479606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.479696] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 is going to be created. [ 693.540018] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.540250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.540328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.540577] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.541267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.553541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: IN_PROGRESS for 2s [ 693.776710] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.777055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.777209] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.777541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.777729] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.777935] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port e61064ad-5de8-494e-9c9b-461a748ce2b3 not found, creating... [ 693.778277] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.778712] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.778712] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.778884] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.779084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.779502] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.779713] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.779869] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.780179] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.780357] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.780555] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: e61064ad-5de8-494e-9c9b-461a748ce2b3 is going to be created. [ 693.799382] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.799790] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.799860] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.800181] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.800427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.800711] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.505377] env[64436]: INFO networking_nsxv3.common.synchronization [req-75ea17db-87df-43f2-bba6-ac4bb87e694a req-2804e2e9-16d4-46ef-9705-dcd991f4c189 service nova] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_rules [ 694.505642] env[64436]: INFO networking_nsxv3.common.synchronization [req-75ea17db-87df-43f2-bba6-ac4bb87e694a req-2804e2e9-16d4-46ef-9705-dcd991f4c189 service nova] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 694.505642] env[64436]: INFO networking_nsxv3.common.synchronization [req-75ea17db-87df-43f2-bba6-ac4bb87e694a req-2804e2e9-16d4-46ef-9705-dcd991f4c189 service nova] Enqueued Resource ID: e61064ad-5de8-494e-9c9b-461a748ce2b3 with Priority: HIGHEST for action port [ 694.506140] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_rules [ 694.506278] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 694.506434] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e61064ad-5de8-494e-9c9b-461a748ce2b3 with Priority: HIGHEST for action port [ 694.506754] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.506928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.507010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.507298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.507377] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.508261] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.508350] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.509980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e61064ad-5de8-494e-9c9b-461a748ce2b3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.509980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.509980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.509980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.509980] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e61064ad-5de8-494e-9c9b-461a748ce2b3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.010650] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.010650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.010849] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e61064ad-5de8-494e-9c9b-461a748ce2b3 with status ACTIVE [ 695.011668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.011668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.011668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.011668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.011668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.011668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.011910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.011910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.011978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.012066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.012206] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.012271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.012358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.012460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.012529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.012606] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e61064ad-5de8-494e-9c9b-461a748ce2b3 is going to be updated. [ 695.016181] env[64436]: INFO networking_nsxv3.common.synchronization [req-502c4fc3-6a7b-4d45-9671-c618abcab2d2 req-d2ee453f-54cc-43ca-b6cb-7533ac601bb4 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 695.016347] env[64436]: INFO networking_nsxv3.common.synchronization [req-502c4fc3-6a7b-4d45-9671-c618abcab2d2 req-d2ee453f-54cc-43ca-b6cb-7533ac601bb4 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 695.017581] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 695.017716] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 695.018569] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.018569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.018569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.018569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.018569] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.019069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.019069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.019069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.019069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.019069] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.020171] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.020291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.020401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.020481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.020618] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.023727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.023727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.023727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.023727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.023727] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.036515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.036644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.036707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.036921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.037072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.037236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e61064ad-5de8-494e-9c9b-461a748ce2b3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.057365] env[64436]: INFO networking_nsxv3.common.synchronization [req-502c4fc3-6a7b-4d45-9671-c618abcab2d2 req-d2ee453f-54cc-43ca-b6cb-7533ac601bb4 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 695.057531] env[64436]: INFO networking_nsxv3.common.synchronization [req-502c4fc3-6a7b-4d45-9671-c618abcab2d2 req-d2ee453f-54cc-43ca-b6cb-7533ac601bb4 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 695.057664] env[64436]: INFO networking_nsxv3.common.synchronization [req-502c4fc3-6a7b-4d45-9671-c618abcab2d2 req-d2ee453f-54cc-43ca-b6cb-7533ac601bb4 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_rules [ 695.057794] env[64436]: INFO networking_nsxv3.common.synchronization [req-502c4fc3-6a7b-4d45-9671-c618abcab2d2 req-d2ee453f-54cc-43ca-b6cb-7533ac601bb4 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 695.057938] env[64436]: INFO networking_nsxv3.common.synchronization [req-502c4fc3-6a7b-4d45-9671-c618abcab2d2 req-d2ee453f-54cc-43ca-b6cb-7533ac601bb4 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 with Priority: HIGHEST for action port [ 695.058148] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 695.058274] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_rules [ 695.058367] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 with Priority: HIGHEST for action port [ 695.058458] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 695.058571] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 695.059057] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.059183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.059253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.059517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.059517] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.060308] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.060383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.060426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.060631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.060711] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.061406] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ebe78e0-81cc-40e3-9299-2295affb5926 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.061514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.061581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.061774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.061810] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ebe78e0-81cc-40e3-9299-2295affb5926',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.062580] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.062708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.062852] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.062935] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.359781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 695.359989] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 deletion is rescheduled due to dependency. [ 695.360134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.360315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.360738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.360828] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.360975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.361103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.361286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.361379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.361490] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.403193] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1230fa-b62e-4bf9-8395-57e5f152f076 req-19b20f54-5eb3-41a5-a05e-6b7fb7f01f6a tempest-ServerAddressesNegativeTestJSON-1650651406 tempest-ServerAddressesNegativeTestJSON-1650651406-project-member] Enqueued Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_members [ 695.403715] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_members [ 695.404031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.404192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.404273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.404515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.404676] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.404851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.404851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.405506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.405969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.405969] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.460090] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.460090] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.460090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.460090] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.523458] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.524587] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.564342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.564580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.565433] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: SUCCESS [ 695.565698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.566019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.566125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.566324] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ebe78e0-81cc-40e3-9299-2295affb5926 with status ACTIVE [ 695.566499] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.566606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.566674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.566907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.567009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.567192] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.567289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.567357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.567510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.567587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.567777] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.567885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.567955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.568121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.568200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.568293] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 is going to be updated. [ 695.588992] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.590019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.590019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.590019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.590019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.590406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.864416] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.910525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.910688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.910757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.911174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.911210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.911385] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.911514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.911576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.911751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.911841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.911952] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 already deleted. [ 695.912045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.962400] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.025955] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.027132] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.303161] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-285 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.303484] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-285" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.303851] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-285" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.306803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-285" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.306803] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.306803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.306803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.311030] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.311030] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.311030] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.311030] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.311030] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.311030] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.311030] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.311030] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.311030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.335236] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.335408] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.335552] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.335737] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-285" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.336073] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d256cb78-0eb7-4b1c-b5f5-9755d292f141 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.336266] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.336371] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.336692] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.336832] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d256cb78-0eb7-4b1c-b5f5-9755d292f141',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.367378] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.466045] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4df507f-e3c4-414d-8e32-1d9e119b190a: rpc.has_security_group_logging(os_id): False [ 696.483507] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.483919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.484119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.484528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.484774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.485251] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.485552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.485716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.486017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.486337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.486570] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be created. [ 696.534022] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.534022] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb is going to be created. [ 696.534022] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.534022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.534022] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 696.543941] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.543941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.543941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.543941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.543941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.557595] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 696.568844] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.568844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.568844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.568844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.568844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.573676] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.573676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.573676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.573676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.573676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.578397] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: UNINITIALIZED for 2s [ 696.579317] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 696.840690] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.840946] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.841220] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.841510] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.841685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.841813] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d256cb78-0eb7-4b1c-b5f5-9755d292f141 not found, creating... [ 696.842104] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.842259] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.842452] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.842579] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.842729] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.842986] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.843152] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.843277] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.843521] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.844449] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.844449] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d256cb78-0eb7-4b1c-b5f5-9755d292f141 is going to be created. [ 696.864543] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.864543] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.864543] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.864856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.864944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.865201] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.869090] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.869240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.869298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.869464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.869543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.869627] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be updated. [ 696.897020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.897020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.897020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.897020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.897020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.905090] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 697.821693] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1230fa-b62e-4bf9-8395-57e5f152f076 req-5e9668e6-58e9-4156-83a7-db7548539ede service nova] Enqueued Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_rules [ 697.822776] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1230fa-b62e-4bf9-8395-57e5f152f076 req-5e9668e6-58e9-4156-83a7-db7548539ede service nova] Enqueued Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_members [ 697.822776] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1230fa-b62e-4bf9-8395-57e5f152f076 req-5e9668e6-58e9-4156-83a7-db7548539ede service nova] Enqueued Resource ID: d256cb78-0eb7-4b1c-b5f5-9755d292f141 with Priority: HIGHEST for action port [ 697.822776] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_rules [ 697.822776] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_members [ 697.822966] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d256cb78-0eb7-4b1c-b5f5-9755d292f141 with Priority: HIGHEST for action port [ 697.823715] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.823825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.823872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.824206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.824325] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.825303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.825420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.825481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.825713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.825878] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.826142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.826142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.826345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.826345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.827150] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.827967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d256cb78-0eb7-4b1c-b5f5-9755d292f141 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.828113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.828183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.828344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.828421] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d256cb78-0eb7-4b1c-b5f5-9755d292f141',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.191728] env[64436]: INFO networking_nsxv3.common.synchronization [req-dd3c773e-5764-49b6-a287-6dc4bd92bce8 req-2b57cfbc-4806-4e7b-b87d-28fedebdafb0 tempest-ServersTestManualDisk-1492175432 tempest-ServersTestManualDisk-1492175432-project-member] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_members [ 698.192324] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_members [ 698.192652] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.192774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.192845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.193424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.193424] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.193559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.193559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.193674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.193762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.193852] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.330585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.330730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.330933] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d256cb78-0eb7-4b1c-b5f5-9755d292f141 with status ACTIVE [ 698.331132] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.331249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.331315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.331518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.331611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.331778] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.331875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.331938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.332110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.332190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.332367] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.332459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.333422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.333422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.333422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.333422] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d256cb78-0eb7-4b1c-b5f5-9755d292f141 is going to be updated. [ 698.333903] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.358512] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.358643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.359203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.359203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.359203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.359364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d256cb78-0eb7-4b1c-b5f5-9755d292f141" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.570387] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 698.571383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.572552] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.573641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.573641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.573641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.573852] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.574873] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.574873] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.574873] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.574873] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.574873] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.575257] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.575257] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.575352] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.575400] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.576547] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.576547] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.599369] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 698.599591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.599759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.600466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.600466] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.600654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.600768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.600979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.601093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.601205] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.606661] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: SUCCESS [ 698.606867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.607099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.607295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.607502] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.607597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.607648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.607851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.607851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.608155] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.631443] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.631443] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.055 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.631443] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.631443] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.631443] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-a307019c-29d9-4c06-9c47-9103c9f19ecc taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.631645] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.631681] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.631989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.632648] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a307019c-29d9-4c06-9c47-9103c9f19ecc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.695996] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.696219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.696280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.696507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.696604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.696806] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.697052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.697141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.697274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.697351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.697436] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 already deleted. [ 698.697518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.840232] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.918408] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 698.918655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.918821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.919051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.919251] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.920642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.920642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.920642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.920642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.920642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.920642] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.103593] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.113115] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.137239] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.137239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.137239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.137239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.137239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.137239] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port a307019c-29d9-4c06-9c47-9103c9f19ecc not found, creating... [ 699.137239] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.137239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.137239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.138384] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.138769] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.139255] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.139605] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.139925] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.140417] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.140667] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.140914] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: a307019c-29d9-4c06-9c47-9103c9f19ecc is going to be created. [ 699.160308] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.160535] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.160613] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.160903] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.161193] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.161633] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.342181] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.342319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.342396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.342645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.342749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.342837] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 is going to be created. [ 699.374161] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.374352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.374414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.374637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.374802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.384934] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 in Status: UNINITIALIZED for 2s [ 699.423899] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.424139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.424338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.424569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.424758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.425204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.425204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.425426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.425426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.425426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.425621] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.425692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.425758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.425898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.426038] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.426173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.426229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.426351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.426443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.426577] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.426681] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.605991] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.614560] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.884787] env[64436]: INFO networking_nsxv3.common.synchronization [req-dd3c773e-5764-49b6-a287-6dc4bd92bce8 req-3afdda70-ab33-4aea-88c3-70fbc6c82b6b service nova] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_rules [ 699.885093] env[64436]: INFO networking_nsxv3.common.synchronization [req-dd3c773e-5764-49b6-a287-6dc4bd92bce8 req-3afdda70-ab33-4aea-88c3-70fbc6c82b6b service nova] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_members [ 699.886043] env[64436]: INFO networking_nsxv3.common.synchronization [req-dd3c773e-5764-49b6-a287-6dc4bd92bce8 req-3afdda70-ab33-4aea-88c3-70fbc6c82b6b service nova] Enqueued Resource ID: a307019c-29d9-4c06-9c47-9103c9f19ecc with Priority: HIGHEST for action port [ 699.886043] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_rules [ 699.886043] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_members [ 699.887322] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a307019c-29d9-4c06-9c47-9103c9f19ecc with Priority: HIGHEST for action port [ 699.889137] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.889264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.889376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.890010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.890010] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.891736] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.891736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.891736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.891736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.891736] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.891736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.891736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.891736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.891736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.891736] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.893055] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a307019c-29d9-4c06-9c47-9103c9f19ecc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.893055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.893055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.893055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.893307] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a307019c-29d9-4c06-9c47-9103c9f19ecc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.929017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a7c16cc-25b5-4f14-86e6-c0818627fd71: rpc.has_security_group_logging(os_id): False [ 699.945757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.945757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.946481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.946481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.946481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.946481] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.946481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.946481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.946692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.946692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.947027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.947027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.947158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.947261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.947382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.947603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.947710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.947757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.947900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.947983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.948078] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be updated. [ 700.012439] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.012663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.012769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.013085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.013309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.028212] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 700.111835] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.111835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.111835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.111835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.112135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.112135] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 700.117241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.117418] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.117500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.117748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.117903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.118186] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb is going to be updated. [ 700.151174] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.152081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.152244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.152503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.153727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.155082] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.155292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.155292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.155503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.155605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.172035] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: IN_PROGRESS for 2s [ 700.172767] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 700.395053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.395265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.395404] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.396506] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a307019c-29d9-4c06-9c47-9103c9f19ecc with status ACTIVE [ 700.396834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.397023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.397142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.397663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.401164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.401401] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.401558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.401804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.402135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.402135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.402219] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.402332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.402428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.402605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.402703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.402810] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a307019c-29d9-4c06-9c47-9103c9f19ecc is going to be updated. [ 700.422460] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.422608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.422673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.422885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.423051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.423257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a307019c-29d9-4c06-9c47-9103c9f19ecc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.817550] env[64436]: INFO networking_nsxv3.common.synchronization [req-e3e6ab71-9ca2-461e-83df-b64976768c4d req-e5781a9f-1f68-454c-bd64-c0cc1ae1fce1 tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 700.818084] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 700.818421] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.818546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.818631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.819791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.819791] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.823580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.823688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.823861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.823954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.824067] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.904991] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.283359] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.283359] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.283359] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.283359] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.283359] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.283359] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.283701] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.283957] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.287123] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.287123] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.287123] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.287123] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.287123] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.287123] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.287123] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.287123] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.302966] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.303173] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.303315] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.303491] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.303809] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.303980] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.304120] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.304456] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.304682] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2667277b-ce73-42ee-ad9b-3bdaadf3d6c7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.329583] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.329808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.329808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.330063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.330121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.330300] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.330416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.330483] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.330590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.330661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.330742] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 701.360855] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.360855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.360855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.360855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.360855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.383544] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 701.395074] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 in Status: SUCCESS [ 701.395265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.395466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.395705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.395901] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.396058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.396127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.396306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.396394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.396474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.396571] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.409616] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.409777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.409839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.410031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.410127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.410223] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 is going to be created. [ 701.452444] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.452590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.452665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.452878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.455717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.468733] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: UNINITIALIZED for 2s [ 701.806975] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.807361] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.807450] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.807656] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.807798] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.807974] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 not found, creating... [ 701.808329] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.808653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.808653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.808819] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.808963] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.809269] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.809574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.809574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.809757] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.809893] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.811051] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 is going to be created. [ 701.831907] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.832551] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.832810] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.833175] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.833689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.834119] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.898841] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.899159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.899159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.899297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.899468] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.899584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.899638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.899773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.899868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.900011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.900201] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.900456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.900456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.900577] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.900628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.900715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.900770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.900906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.900983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.901080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.901209] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.041414] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 702.041414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.143930] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_members [ 702.144192] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 702.144324] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 702.144915] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_members [ 702.145228] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 702.145287] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 702.145580] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d56968f0-09ac-450f-b3be-d23e15b46d5b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.145723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.145781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.148331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.148331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.148331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.148331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.148331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.148331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.148331] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.152154] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.152333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.152605] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.152696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.182425] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: SUCCESS [ 702.182425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.183156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.183427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.183697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.183836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.183907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.184275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.184387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.184513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.184709] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.186489] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 702.187149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.187454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.187708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.187831] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.187954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.188020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.188181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.188269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.188355] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.189171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.189336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.189516] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.189625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.189699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.189822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.189902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.190015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.190105] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.192686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.192867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.193405] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.193405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.193528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.193562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.193645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.193731] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.245120] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 702.245553] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 702.247025] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_rules [ 702.247025] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 702.247025] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_rules [ 702.247025] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_members [ 702.247025] env[64436]: INFO networking_nsxv3.common.synchronization [req-25548417-7dac-4c4d-9718-9e20d399bea9 req-49debc6e-1eaf-4920-a0fa-47c8eb2d009f tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 with Priority: HIGHEST for action port [ 702.247673] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_rules [ 702.248119] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_rules [ 702.248476] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_members [ 702.248859] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 with Priority: HIGHEST for action port [ 702.252185] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_rules [ 702.252185] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 702.252185] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 702.252185] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.252185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.252185] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.252185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.252185] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d56968f0-09ac-450f-b3be-d23e15b46d5b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.252185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.252185] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ebe78e0-81cc-40e3-9299-2295affb5926 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.252185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.252185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.252185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.252185] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ebe78e0-81cc-40e3-9299-2295affb5926',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.252185] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d56968f0-09ac-450f-b3be-d23e15b46d5b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.253393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.253638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.254036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.254260] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.256489] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.256847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.257271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.257963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.403650] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddee3b8b-6805-4cc6-99b5-47b0c8059fc3: rpc.has_security_group_logging(os_id): False [ 702.423179] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.423179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.423179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.423629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.423629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.423697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.424533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.424533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.424533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.424533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.424533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.424533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.424533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.424830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.424830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.425040] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.426142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.426142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.426361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.426575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.426724] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 is going to be created. [ 702.479696] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.479857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.479973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.480222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.480466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.488995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 in Status: IN_PROGRESS for 2s [ 702.628804] env[64436]: INFO networking_nsxv3.common.synchronization [req-e3e6ab71-9ca2-461e-83df-b64976768c4d req-ee74daf7-d793-4ede-b7bf-4737d8d35f4d service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 702.628996] env[64436]: INFO networking_nsxv3.common.synchronization [req-e3e6ab71-9ca2-461e-83df-b64976768c4d req-ee74daf7-d793-4ede-b7bf-4737d8d35f4d service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 702.629195] env[64436]: INFO networking_nsxv3.common.synchronization [req-e3e6ab71-9ca2-461e-83df-b64976768c4d req-ee74daf7-d793-4ede-b7bf-4737d8d35f4d service nova] Enqueued Resource ID: 2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 with Priority: HIGHEST for action port [ 702.629453] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 702.629584] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 702.629723] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 with Priority: HIGHEST for action port [ 702.633357] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.633527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.633593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.633804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.633888] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.636317] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.636416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.636828] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.636828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.636828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.637060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.637060] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2667277b-ce73-42ee-ad9b-3bdaadf3d6c7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.653470] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.691626] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.692529] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.697443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.697591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.697748] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.762029] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ebe78e0-81cc-40e3-9299-2295affb5926 with status ACTIVE [ 702.762029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.762029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.762029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.762029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.762029] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ebe78e0-81cc-40e3-9299-2295affb5926 is going to be updated. [ 702.763291] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d56968f0-09ac-450f-b3be-d23e15b46d5b taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.763389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.782727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.782862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.782936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.783152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.783290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.783449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ebe78e0-81cc-40e3-9299-2295affb5926" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.140276] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.140586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.140636] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 with status ACTIVE [ 703.140907] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.141029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.141096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.141294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.141379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.141547] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.141639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.141700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.141844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.141919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.142130] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.142223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.142272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.142405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.142477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.142559] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2667277b-ce73-42ee-ad9b-3bdaadf3d6c7 is going to be updated. [ 703.157036] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.161704] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.161704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.161704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.161833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.161911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.163255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2667277b-ce73-42ee-ad9b-3bdaadf3d6c7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.195987] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.196504] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2485258-5c59-4503-a9df-3f4d9b5bebdb: rpc.has_security_group_logging(os_id): False [ 703.204026] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.221586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.221729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.222357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.222357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.222357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.222357] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.222549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.222549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.222617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.222676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.222761] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb is going to be created. [ 703.286889] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.287151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.287204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.287445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.287586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.301658] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: IN_PROGRESS for 2s [ 703.395594] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 703.395912] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 deletion is rescheduled due to dependency. [ 703.396073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.396921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.397207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.397407] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.397531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.397603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.397880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.397880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.397974] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.478722] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: SUCCESS [ 703.480286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.480286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.480286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.480286] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.480701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.480701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.480701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.480701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.480885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.480885] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.623292] env[64436]: INFO networking_nsxv3.common.synchronization [req-c827e23b-5949-4ea2-9d37-9fa6c5b831a6 req-08b72391-fd58-4218-9cff-61c84b9eb47b tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 703.623292] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 703.623292] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.623292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.623292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.623292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.624059] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.624177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.624252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.624517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.624517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.624673] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.659203] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.659387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.659556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.659657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.659748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.659843] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d56968f0-09ac-450f-b3be-d23e15b46d5b is going to be created. [ 703.683197] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.683294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.683374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.683951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.684144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.692623] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d56968f0-09ac-450f-b3be-d23e15b46d5b in Status: UNINITIALIZED for 2s [ 703.699208] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.700244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.700244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.700244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.700244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.700244] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb is going to be updated. [ 703.703429] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.703610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.703610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.703832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.703832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.704135] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 703.726819] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.726819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.726819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.726819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.726819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.727840] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.728015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.728202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.728416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.728579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.739731] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 703.740459] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: IN_PROGRESS for 2s [ 703.899950] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.984103] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.078455] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.078644] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.078765] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.079035] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.079310] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.079468] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.079582] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.079793] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.079931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.080152] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.080262] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.080367] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.080466] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.080574] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.080674] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.080799] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.099041] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.099227] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.099485] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.099746] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.102110] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-058e7275-49bc-4fc2-9f35-9aa29073172d taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.102110] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.102110] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.102110] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.102110] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('058e7275-49bc-4fc2-9f35-9aa29073172d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.127556] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.127556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.127556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.127889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.127889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.127956] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.128192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.128269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.128452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.128661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.128661] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 704.154141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.154141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.154141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.154141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.154141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.160731] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 704.403074] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.491023] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4e1163d-f97e-451a-89d1-745f57f66535: rpc.has_security_group_logging(os_id): False [ 704.505203] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 in Status: SUCCESS [ 704.505385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.508684] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.508925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.508925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.509168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.509297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.509677] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.509836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.509907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.510152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.510152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.510289] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 is going to be created. [ 704.572469] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.572975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.572975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.573099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.573327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.586929] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: IN_PROGRESS for 2s [ 704.607157] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.607745] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.608917] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.609234] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.609485] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.609718] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 058e7275-49bc-4fc2-9f35-9aa29073172d not found, creating... [ 704.610056] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.613017] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.613017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.613017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 058e7275-49bc-4fc2-9f35-9aa29073172d is going to be created. [ 704.647945] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.647945] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.647945] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.648291] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.648327] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.648880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.906034] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.906216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.906377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.906518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.906580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.906679] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 704.933106] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.933285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.933285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.933510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.934266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.942146] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 705.313389] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: SUCCESS [ 705.313671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.314834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.314834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.314834] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.692837] env[64436]: INFO networking_nsxv3.common.synchronization [req-c827e23b-5949-4ea2-9d37-9fa6c5b831a6 req-75988be5-33bb-4aad-8154-3d3684bc174c service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 705.692837] env[64436]: INFO networking_nsxv3.common.synchronization [req-c827e23b-5949-4ea2-9d37-9fa6c5b831a6 req-75988be5-33bb-4aad-8154-3d3684bc174c service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 705.692837] env[64436]: INFO networking_nsxv3.common.synchronization [req-c827e23b-5949-4ea2-9d37-9fa6c5b831a6 req-75988be5-33bb-4aad-8154-3d3684bc174c service nova] Enqueued Resource ID: 058e7275-49bc-4fc2-9f35-9aa29073172d with Priority: HIGHEST for action port [ 705.692837] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 705.692837] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 705.692837] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058e7275-49bc-4fc2-9f35-9aa29073172d with Priority: HIGHEST for action port [ 705.692837] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.692837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.692837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.692837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.692837] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.694327] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.694327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.694628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-058e7275-49bc-4fc2-9f35-9aa29073172d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.694628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.694790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.694841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.694890] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('058e7275-49bc-4fc2-9f35-9aa29073172d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.705702] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d56968f0-09ac-450f-b3be-d23e15b46d5b in Status: SUCCESS [ 705.705952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.706175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.706904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.706904] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.706904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.706904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.706904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.707220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.707220] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.751779] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: SUCCESS [ 705.752043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.752883] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 705.752952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.753125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.753338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.753520] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.753674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.753728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.753846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.753931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.754709] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.755648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.755733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.755908] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.756054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.756127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.756274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.756357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.756447] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.820436] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.820816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.892362] env[64436]: INFO networking_nsxv3.common.synchronization [req-728a0520-337d-44e1-85ec-06df5839d792 req-b31afb96-d063-4015-b2f4-e85aca5c5a86 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_members [ 705.892569] env[64436]: INFO networking_nsxv3.common.synchronization [req-728a0520-337d-44e1-85ec-06df5839d792 req-b31afb96-d063-4015-b2f4-e85aca5c5a86 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 705.892695] env[64436]: INFO networking_nsxv3.common.synchronization [req-728a0520-337d-44e1-85ec-06df5839d792 req-b31afb96-d063-4015-b2f4-e85aca5c5a86 tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 705.893219] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d56968f0-09ac-450f-b3be-d23e15b46d5b with Priority: HIGHEST for action security_group_members [ 705.893371] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb with Priority: HIGHEST for action security_group_members [ 705.893472] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 705.893733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d56968f0-09ac-450f-b3be-d23e15b46d5b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.893835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.894454] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2485258-5c59-4503-a9df-3f4d9b5bebdb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.894589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.894804] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.894901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.172794] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 706.172984] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 706.173238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.175343] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f5e6343-2a72-43a4-9d8a-ee573f70bc4d req-a585cc3b-f4ae-469c-bf05-aab76a62e293 tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 706.176593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.178580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.178848] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.179594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.179754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.179991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.180137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.180740] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.181730] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 706.182409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.182573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.182674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.182886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.183100] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.183245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.183390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.183762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.183898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.184039] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.199260] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.199523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.202173] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 058e7275-49bc-4fc2-9f35-9aa29073172d with status ACTIVE [ 706.202173] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.202173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.202173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.202173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.202569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.202941] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.202941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.202941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.203112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.203142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.203347] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.203411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.203536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.203606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.203685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.203778] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 058e7275-49bc-4fc2-9f35-9aa29073172d is going to be updated. [ 706.208963] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.227218] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.227413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.227521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.227826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.228255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.228391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-058e7275-49bc-4fc2-9f35-9aa29073172d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.261903] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.263097] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.544102] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.544448] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.545162] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.545811] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.547180] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.547180] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.547180] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.547180] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.547696] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.548083] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.548372] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.548549] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.548739] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.548923] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.549120] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.549394] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.568919] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.568919] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.568919] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.568919] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-234" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.569141] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-a8b995d4-e49e-443b-88de-1738071966ae taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.569350] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.569514] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.569965] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.573018] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8b995d4-e49e-443b-88de-1738071966ae',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.601799] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: SUCCESS [ 706.602194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.686691] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.687746] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.711356] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.766805] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.768345] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.957110] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 706.957403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.961020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.961020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.961020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.961020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.961020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.961020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.961020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.961020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.961020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.076475] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.076475] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port a8b995d4-e49e-443b-88de-1738071966ae not found, creating... [ 707.076475] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.076475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.076872] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.076872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.076872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.077113] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.077397] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.077397] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: a8b995d4-e49e-443b-88de-1738071966ae is going to be created. [ 707.098856] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.099113] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.099393] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.100172] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.100172] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.100172] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.190270] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.191332] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.216513] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.216600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.216675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.216954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.217099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.217255] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d56968f0-09ac-450f-b3be-d23e15b46d5b is going to be updated. [ 707.256190] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.256340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.256400] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.256619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.256791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.265659] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d56968f0-09ac-450f-b3be-d23e15b46d5b in Status: IN_PROGRESS for 2s [ 707.271632] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.271779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.271852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.272081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.272196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.272297] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 707.273940] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.274179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.274302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.274503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.274596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.274701] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb is going to be updated. [ 707.316389] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.316584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.316642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.316810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.316955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.319172] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.319319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.319408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.319596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.319768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.328488] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 707.329172] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: IN_PROGRESS for 2s [ 707.462032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.462032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.462032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.462032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.462032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.462032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.462032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.462877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.462877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.462877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.462877] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.462877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.462877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.463199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.463199] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.463414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.463509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.463676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.463778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.463902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.464023] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.695356] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.695671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.695671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.695883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.696060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.696312] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 707.699175] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.699175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.703067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.703067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.703067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.703067] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 707.728210] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.728961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.728961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.728961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.729157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.734032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.734032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.734032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.734032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.734032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.742254] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 707.744189] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 707.934520] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f5e6343-2a72-43a4-9d8a-ee573f70bc4d req-51868dda-36b3-468b-99f4-8beaac64da96 service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 707.934743] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f5e6343-2a72-43a4-9d8a-ee573f70bc4d req-51868dda-36b3-468b-99f4-8beaac64da96 service nova] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 707.934981] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f5e6343-2a72-43a4-9d8a-ee573f70bc4d req-51868dda-36b3-468b-99f4-8beaac64da96 service nova] Enqueued Resource ID: a8b995d4-e49e-443b-88de-1738071966ae with Priority: HIGHEST for action port [ 707.935627] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_rules [ 707.935761] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 707.935864] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8b995d4-e49e-443b-88de-1738071966ae with Priority: HIGHEST for action port [ 707.936979] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.937211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.937667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.937667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.937667] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.938635] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.938778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.941126] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8b995d4-e49e-443b-88de-1738071966ae taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.941350] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.941444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.942107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.942107] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8b995d4-e49e-443b-88de-1738071966ae',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.966615] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a22f030d-b590-48f1-adde-d139f2aa31d4: rpc.has_security_group_logging(os_id): False [ 707.987116] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.987116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.987116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.987116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.987388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.988131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.988333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.988447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.988703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.990247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.990655] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.990932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.991036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.991336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.991491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.991891] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.992109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.992244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.992532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.992944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.992944] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 708.088323] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.088590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.089037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.089123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.089340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.112532] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 708.447418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.447597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.447898] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8b995d4-e49e-443b-88de-1738071966ae with status ACTIVE [ 708.448195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.448348] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.448604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.448742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.448872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.449142] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.449287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.449383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.449606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.449726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.449991] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.450257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.450358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.450573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.450686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.450813] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8b995d4-e49e-443b-88de-1738071966ae is going to be updated. [ 708.471160] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.471328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.471366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.471545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.471675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.471828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8b995d4-e49e-443b-88de-1738071966ae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.231736] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f3b07b3-c612-4ac7-a745-3037edd64553 req-8787f05e-d523-470f-8e19-daf37a358363 tempest-ServerRescueTestJSON-102856840 tempest-ServerRescueTestJSON-102856840-project-member] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 709.231736] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 709.232940] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.233299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.234059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.234550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.236049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.236049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.236049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.236049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.236049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.236049] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.277316] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d56968f0-09ac-450f-b3be-d23e15b46d5b in Status: SUCCESS [ 709.277660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.278333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.278647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.278911] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.279084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.279186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.279437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.280744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.280744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.280744] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.281265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.281498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.281765] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.281931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.282055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.286028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.286028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.286028] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.347107] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 709.347726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.348613] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: SUCCESS [ 709.348910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.349015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.349254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.349444] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.350859] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.350859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.351557] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.351557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.351557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.351822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.351822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.351981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.351981] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.353419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.353419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.353419] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.353583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.353583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.354142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.354142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.354142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.354142] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.355082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.355915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.356116] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.356248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.356323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.356582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.356582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.356678] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.358128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.358308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.358488] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.358649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.358755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.359116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.359259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.359259] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.691700] env[64436]: INFO networking_nsxv3.common.synchronization [req-5f8905f1-300b-4be4-bfb5-7893549e5eab req-9983fc19-f8f2-4c8a-b1ea-d66430950e6f tempest-ServerAddressesNegativeTestJSON-1650651406 tempest-ServerAddressesNegativeTestJSON-1650651406-project-member] Enqueued Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_members [ 709.692502] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 with Priority: HIGHEST for action security_group_members [ 709.692950] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.693155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.694213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.694213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.694213] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.694213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.694213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.694458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.694521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.694682] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddee3b8b-6805-4cc6-99b5-47b0c8059fc3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.740281] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.753808] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 709.754405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.755069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.755264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.755561] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.755886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.756119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.756564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.756564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.756677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.756808] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.759532] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 709.759532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.759864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.763511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.763511] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.763511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.763511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.763511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.763511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.763511] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.784118] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d56968f0-09ac-450f-b3be-d23e15b46d5b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.785811] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.785987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.786099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.786377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.786496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.786745] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.786877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.786963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.787452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.787617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.787779] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d56968f0-09ac-450f-b3be-d23e15b46d5b is going to be deleted. [ 709.799033] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-747 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.799033] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.799498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.799611] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.799998] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.800396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.800610] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.800973] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.801362] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.801695] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.801907] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.802123] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.802326] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.802541] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.802742] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.802983] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.826564] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.826841] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.827091] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.827392] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-747" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.827773] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-4e267636-ffe7-4a8f-ab30-9784d36d57c1 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.828035] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.829210] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.829782] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.830061] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e267636-ffe7-4a8f-ab30-9784d36d57c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.836000] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.836279] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.836399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.836650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.836777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.836925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.858393] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.861580] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9741d578-5b29-42b0-b0b6-dfd97b1c7306: rpc.has_security_group_logging(os_id): False [ 709.862851] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2485258-5c59-4503-a9df-3f4d9b5bebdb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.863863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.864243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.864376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.868074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.868074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.868074] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.868074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.868074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.868074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.868074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.868074] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb is going to be updated. [ 709.885063] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.885259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.885314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.885897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.885897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.885897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.886111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.886111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.886861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.887196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.887590] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.887775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.887884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.888181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.888320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.888636] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.888830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.888973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.889202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.889295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.889413] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 709.920168] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.920168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.920168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.921333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.921582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.930138] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: IN_PROGRESS for 2s [ 709.971537] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.971772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.971852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.972111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.972295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.987923] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 710.131991] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 710.131991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.198676] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.198873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.198922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.199151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.199244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.199464] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.199568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.199640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.200304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.200304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.200304] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 is going to be updated. [ 710.244289] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.254131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.254131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.254375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.256145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.256145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.262530] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 in Status: IN_PROGRESS for 2s [ 710.264432] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.264630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.264711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.264888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.265080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.265186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.265245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.265402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.265507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.265605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.265757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.265868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.265939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.266091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.266231] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.266800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.266800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.266800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.266800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.266800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.266800] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.267759] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.291192] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d56968f0-09ac-450f-b3be-d23e15b46d5b: rpc.has_security_group_logging(os_id): False [ 710.309815] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.310099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.310099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.310646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.310646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.310646] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.311579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.311579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.311579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.311579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.311579] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d56968f0-09ac-450f-b3be-d23e15b46d5b is going to be created. [ 710.330727] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d56968f0-09ac-450f-b3be-d23e15b46d5b], does not exist path=[/infra/domains/default/groups/d56968f0-09ac-450f-b3be-d23e15b46d5b]."\n}' [ 710.330727] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d56968f0-09ac-450f-b3be-d23e15b46d5b failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d56968f0-09ac-450f-b3be-d23e15b46d5b [ 710.330727] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 710.332905] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.332905] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.332905] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.332905] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.333192] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.333463] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 4e267636-ffe7-4a8f-ab30-9784d36d57c1 not found, creating... [ 710.333760] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.333985] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.334205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.334842] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.334959] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.335465] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.335764] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.336584] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.336584] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.336724] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.336815] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 4e267636-ffe7-4a8f-ab30-9784d36d57c1 is going to be created. [ 710.360698] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.367818] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2485258-5c59-4503-a9df-3f4d9b5bebdb: rpc.has_security_group_logging(os_id): False [ 710.381485] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.381713] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.381785] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.382564] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.382788] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.383423] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.403843] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.404115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.404310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.405223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.405223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.405223] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.405223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.405552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.405552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.405552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.405695] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb is going to be updated. [ 710.409533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.409892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.410063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.410257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.413963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.413963] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.413963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.414305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.414446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.414522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.414860] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.415215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.415459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.415546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.415622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.415691] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d56968f0-09ac-450f-b3be-d23e15b46d5b is going to be created. [ 710.439617] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d56968f0-09ac-450f-b3be-d23e15b46d5b], does not exist path=[/infra/domains/default/groups/d56968f0-09ac-450f-b3be-d23e15b46d5b]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d56968f0-09ac-450f-b3be-d23e15b46d5b [ 710.439871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d56968f0-09ac-450f-b3be-d23e15b46d5b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.440474] env[64436]: Traceback (most recent call last): [ 710.440513] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 710.440513] env[64436]: return func(*args, **kwargs) [ 710.440513] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 710.440513] env[64436]: res.raise_for_status() [ 710.440513] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 710.440513] env[64436]: raise HTTPError(http_error_msg, response=self) [ 710.440513] env[64436]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d56968f0-09ac-450f-b3be-d23e15b46d5b [ 710.440513] env[64436]: During handling of the above exception, another exception occurred: [ 710.440513] env[64436]: Traceback (most recent call last): [ 710.440768] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 710.440768] env[64436]: listener.cb(fileno) [ 710.440768] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 710.440768] env[64436]: result = function(*args, **kwargs) [ 710.440768] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 710.440768] env[64436]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 710.440768] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 710.440768] env[64436]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 710.440768] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 710.440768] env[64436]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 710.440768] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 710.440768] env[64436]: res.raise_for_status() [ 710.440768] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 710.440768] env[64436]: raise HTTPError(http_error_msg, response=self) [ 710.440768] env[64436]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d56968f0-09ac-450f-b3be-d23e15b46d5b [ 710.440768] env[64436]: Removing descriptor: 23 [ 710.497018] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.497327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.497327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.497457] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.497620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.513265] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: IN_PROGRESS for 2s [ 710.746518] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.746819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.746952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.747381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.747559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.747707] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 is going to be updated. [ 710.770091] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f75433d-92b0-49c0-b145-a45f748925ab: rpc.has_security_group_logging(os_id): False [ 710.772639] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.779514] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.779781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.779781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.780085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.780258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.791426] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.791426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.791426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.791426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.792246] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: IN_PROGRESS for 2s [ 710.809829] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.810112] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.810257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.810324] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.810885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.810885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.810885] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.811291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.811291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.811291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.811452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.812079] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.812079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.812079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.812079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.812369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.812369] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 710.864478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.864478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.864724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.864724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.864883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.864944] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 710.874188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.874442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.874442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.874872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.874872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.892698] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 710.910242] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.910509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.910609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.910878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.911033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.921610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 711.103992] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f3b07b3-c612-4ac7-a745-3037edd64553 req-8a441783-0072-4df5-8571-645d8adec66c service nova] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_rules [ 711.104403] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f3b07b3-c612-4ac7-a745-3037edd64553 req-8a441783-0072-4df5-8571-645d8adec66c service nova] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 711.104403] env[64436]: INFO networking_nsxv3.common.synchronization [req-1f3b07b3-c612-4ac7-a745-3037edd64553 req-8a441783-0072-4df5-8571-645d8adec66c service nova] Enqueued Resource ID: 4e267636-ffe7-4a8f-ab30-9784d36d57c1 with Priority: HIGHEST for action port [ 711.104601] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_rules [ 711.104721] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 711.104772] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e267636-ffe7-4a8f-ab30-9784d36d57c1 with Priority: HIGHEST for action port [ 711.107102] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.107102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.107102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.107414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.107414] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.111520] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.111520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.111520] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e267636-ffe7-4a8f-ab30-9784d36d57c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.111520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.111520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.111520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.111520] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e267636-ffe7-4a8f-ab30-9784d36d57c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.276946] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.277511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.277603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.277919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.278062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.278195] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 711.317473] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.317757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.317757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.318169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.318169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.329502] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 711.612513] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.612710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.615217] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e267636-ffe7-4a8f-ab30-9784d36d57c1 with status ACTIVE [ 711.615410] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.615584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.615687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.615930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.616058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.616272] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.616765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.616765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.616765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.616765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.616967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.617206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.617323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.617512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.617614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.617722] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e267636-ffe7-4a8f-ab30-9784d36d57c1 is going to be updated. [ 711.639504] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.639807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.639852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.640077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.640211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.640377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e267636-ffe7-4a8f-ab30-9784d36d57c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.943412] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: SUCCESS [ 711.943412] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb deletion is rescheduled due to dependency. [ 711.943412] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.006796] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 712.006796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.006796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.006796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.006796] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.277424] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 in Status: SUCCESS [ 712.277861] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddee3b8b-6805-4cc6-99b5-47b0c8059fc3 deletion is rescheduled due to dependency. [ 712.277861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddee3b8b-6805-4cc6-99b5-47b0c8059fc3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.511527] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.513029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.526865] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2485258-5c59-4503-a9df-3f4d9b5bebdb in Status: SUCCESS [ 712.527169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2485258-5c59-4503-a9df-3f4d9b5bebdb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.806030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: SUCCESS [ 712.806438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.806438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.807745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.807745] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.807745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.807745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.807745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.807745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.807745] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.906617] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 712.906751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.930762] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 712.931581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.932193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.932542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.932817] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.933126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.933307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.933574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.933745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.933901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.934039] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.315062] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.339776] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 713.341510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.341642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.341866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.343148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.343311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.343410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.343607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.344959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.344959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.344959] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.438020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.438220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.438220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.438583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.438889] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.439122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.439278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.439546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.439696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.439864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.440136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.440299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.440373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.440584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.440801] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.440913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.440980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.441228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.441339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.441449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.441562] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.818135] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.847809] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.847961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.849586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.849586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.849586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.849586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.849586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.849586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.849586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.849865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.849907] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.850682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.851181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.851484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.851801] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.852040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.852126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.852379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.852535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.852658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.852827] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.945475] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9741d578-5b29-42b0-b0b6-dfd97b1c7306: rpc.has_security_group_logging(os_id): False [ 713.966105] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.966328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.966424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.966754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.985484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.985773] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.985904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.985974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.986252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.986371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.986613] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.986746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.986838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.986988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.988012] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.988269] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.988391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.988459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.988630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.988781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.988839] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 714.062397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.062565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.062620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.062845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.063050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.081451] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 714.321502] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.321502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.321502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.321502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.321919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.321919] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 is going to be updated. [ 714.350872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.351044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.351126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.351328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.351593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.357878] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeeb0085-3d91-4859-b6e8-d553406b2219: rpc.has_security_group_logging(os_id): False [ 714.362367] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: IN_PROGRESS for 2s [ 714.375834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.376766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.376766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.376766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.394283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.394538] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.394662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.394849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.394920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.394985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.396136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.396136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.396136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.396136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.396136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.396136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.396136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.396136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.398157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.398157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.398157] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 714.452874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.453038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.453076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.453349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.453526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.466889] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 715.278396] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 715.278634] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent loop - iteration:1 started [ 716.101637] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 716.101918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.105707] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 716.105707] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 716.373548] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: SUCCESS [ 716.373548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.373548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.373548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.373548] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.373926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.373926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.373926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.373926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.374692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.374692] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.490658] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 716.490912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.758751] env[64436]: INFO networking_nsxv3.common.synchronization [req-8dd757b6-f1a7-4d6a-8748-ee81120b748c req-f6b4b41a-2266-4c21-a523-ba5d76e7fe90 tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 716.760689] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 716.761485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.761485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.761485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.761485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.762013] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.762013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.762013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.762013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.762222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.762222] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.880493] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.880493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.880493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.880493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.880664] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.881391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.881391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.881507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.881507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.881605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.881765] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.881862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.881975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.882150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.882295] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.882391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.882454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.882985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.883061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.883790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.883790] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.265462] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.266020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.266941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.267056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.287051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.287407] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.287546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.287637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.287775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.287867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.287933] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be updated. [ 717.320572] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.321307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.323018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.323018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.323018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.332756] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 717.386474] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e04160bc-db4b-4c32-8c62-3a41769c7c95: rpc.has_security_group_logging(os_id): False [ 717.404545] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.404722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.404793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.405014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.423264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.423512] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.424421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.424421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.424421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.424421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.424421] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.424421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.424421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.424758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.424758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.424758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.424902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.424902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.424988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.425166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.425271] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 is going to be updated. [ 717.479177] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.479412] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.480048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.480048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.480048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.491772] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: IN_PROGRESS for 2s [ 719.345991] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 719.346459] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 deletion is rescheduled due to dependency. [ 719.346553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.496628] env[64436]: INFO networking_nsxv3.common.synchronization [req-ed2efc95-4e9c-4da6-b301-a8c0cd9b55d4 req-2401079f-afaf-4d8b-8627-88fecf098586 tempest-ServersNegativeTestJSON-1058932887 tempest-ServersNegativeTestJSON-1058932887-project-member] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 719.497317] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 719.498834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.498834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.498834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.498834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.498834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.498834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.498834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.499406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.499406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.499406] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.508402] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: SUCCESS [ 719.508516] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.856194] env[64436]: INFO networking_nsxv3.common.synchronization [None req-de42d748-79a9-478f-9788-391c5299bc7b None None] Enqueued Resource ID: 517d9def-4c33-4081-89bb-43b61240a396 with Priority: HIGHEST for action port [ 719.856454] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 517d9def-4c33-4081-89bb-43b61240a396 with Priority: HIGHEST for action port [ 719.857362] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-517d9def-4c33-4081-89bb-43b61240a396 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.857362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-517d9def-4c33-4081-89bb-43b61240a396" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.857362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-517d9def-4c33-4081-89bb-43b61240a396" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.857906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-517d9def-4c33-4081-89bb-43b61240a396" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.857906] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('517d9def-4c33-4081-89bb-43b61240a396',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.867982] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.868234] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.868383] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.868675] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.868959] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.869138] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.869290] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.869511] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.869676] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.869912] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.871125] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.871125] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.871125] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.871125] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.871125] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.871125] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.890384] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.890560] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.890713] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.890898] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 719.891264] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.891450] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 719.891629] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.891958] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 719.892116] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6614d3fb-7f1f-42f1-b25e-5bf7109f1ece',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.003481] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.367464] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 517d9def-4c33-4081-89bb-43b61240a396 [ 720.367730] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.367845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.367914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.368144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.368224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.368348] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:517d9def-4c33-4081-89bb-43b61240a396 already deleted. [ 720.368400] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-517d9def-4c33-4081-89bb-43b61240a396" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.396463] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.396463] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.396463] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.396694] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.396777] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.396936] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 6614d3fb-7f1f-42f1-b25e-5bf7109f1ece not found, creating... [ 720.397398] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.398628] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.398628] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.398628] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.398628] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.398628] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.398882] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.398882] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.400080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.400080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.401032] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 6614d3fb-7f1f-42f1-b25e-5bf7109f1ece is going to be created. [ 720.422064] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.422064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 720.422064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.422064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 720.422402] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.422548] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 720.506339] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.012707] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.012873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.013119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.013359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.013359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.013529] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be updated. [ 721.043064] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.044310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.044502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.044743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.045322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.056412] env[64436]: INFO networking_nsxv3.common.synchronization [None req-620f68c1-844a-4807-835c-888ad7eae29d tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_rules [ 721.056412] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 721.057012] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_rules [ 721.057308] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.057647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.057757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.058776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.058776] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.202721] env[64436]: INFO networking_nsxv3.common.synchronization [None req-e37f01c9-c40f-4be3-b5ac-37c5f9e5f568 tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_rules [ 721.202935] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_rules [ 721.204188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.204188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.321481] env[64436]: INFO networking_nsxv3.common.synchronization [req-ed2efc95-4e9c-4da6-b301-a8c0cd9b55d4 req-4bf35884-c86d-40e6-914d-b12b3c52a2e3 service nova] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_rules [ 721.322312] env[64436]: INFO networking_nsxv3.common.synchronization [req-ed2efc95-4e9c-4da6-b301-a8c0cd9b55d4 req-4bf35884-c86d-40e6-914d-b12b3c52a2e3 service nova] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 721.322524] env[64436]: INFO networking_nsxv3.common.synchronization [req-ed2efc95-4e9c-4da6-b301-a8c0cd9b55d4 req-4bf35884-c86d-40e6-914d-b12b3c52a2e3 service nova] Enqueued Resource ID: 6614d3fb-7f1f-42f1-b25e-5bf7109f1ece with Priority: HIGHEST for action port [ 721.323148] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_rules [ 721.324034] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 721.324199] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6614d3fb-7f1f-42f1-b25e-5bf7109f1ece with Priority: HIGHEST for action port [ 721.324531] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.325293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.325389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.325622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.325712] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.326786] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.326896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.327035] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.327264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.327360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.327569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.327652] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6614d3fb-7f1f-42f1-b25e-5bf7109f1ece',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.581238] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.581238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.581705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.581705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.581705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.581804] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca0f983-827d-4279-9163-19aa19101851 already deleted. [ 721.581858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.582797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.582797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.582797] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.833368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.833368] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6614d3fb-7f1f-42f1-b25e-5bf7109f1ece with status ACTIVE [ 721.833368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.833368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.833368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.833368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.833980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.833980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.833980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.833980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.833980] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6614d3fb-7f1f-42f1-b25e-5bf7109f1ece is going to be updated. [ 721.863401] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.863603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.863644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.863845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.864013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.864181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6614d3fb-7f1f-42f1-b25e-5bf7109f1ece" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.105256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.105426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.105547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.108446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.108446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.108446] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca0f983-827d-4279-9163-19aa19101851 already deleted. [ 722.108446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.312990] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-9030af6d-3a08-4cb6-a3b2-437438956999 tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 722.313551] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 722.313883] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.313978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.314899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.315199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.315364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.315521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.315585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.315710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.315819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.316060] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.711625] env[64436]: INFO networking_nsxv3.common.synchronization [None req-47e5b228-e9e4-4ed2-b1d3-c5f5ac2e797a None None] Enqueued Resource ID: 27d95840-2fec-4425-a96c-b0a921bd2ea7 with Priority: HIGHEST for action port [ 722.711625] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27d95840-2fec-4425-a96c-b0a921bd2ea7 with Priority: HIGHEST for action port [ 722.712076] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-27d95840-2fec-4425-a96c-b0a921bd2ea7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.712204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27d95840-2fec-4425-a96c-b0a921bd2ea7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.712274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27d95840-2fec-4425-a96c-b0a921bd2ea7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.712543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27d95840-2fec-4425-a96c-b0a921bd2ea7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.712599] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27d95840-2fec-4425-a96c-b0a921bd2ea7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.821553] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.821743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.821802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.821987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.843107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.843107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.843107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.843107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.843107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.843107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.843107] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 722.864482] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.864634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.864677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.864885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.865033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.873306] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 722.959154] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.959496] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.959581] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.959878] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.960252] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.960379] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.960423] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.960627] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.960844] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.961559] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.961559] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.961559] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.961559] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.961559] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.962053] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.962053] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.978208] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.978392] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.978535] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.978709] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 722.979494] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-0d194f08-ff26-413f-a715-1d412fee15f9 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.979718] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 722.979785] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.980160] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 722.980303] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d194f08-ff26-413f-a715-1d412fee15f9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.068757] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 723.068757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.068757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.068757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.068757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.068757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.068757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.068757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.068757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.068757] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.217290] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27d95840-2fec-4425-a96c-b0a921bd2ea7 [ 723.217290] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.217290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.217290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.217290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.217290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.217290] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27d95840-2fec-4425-a96c-b0a921bd2ea7 already deleted. [ 723.217290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27d95840-2fec-4425-a96c-b0a921bd2ea7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.483617] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.485168] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.485168] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.485168] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.485168] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.485387] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 0d194f08-ff26-413f-a715-1d412fee15f9 not found, creating... [ 723.485638] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.485906] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.486802] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.487207] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.487482] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.487988] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.488405] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.488624] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.489014] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.489259] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.489708] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 0d194f08-ff26-413f-a715-1d412fee15f9 is going to be created. [ 723.512485] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.512485] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.512485] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.513101] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.513661] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.513661] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.571737] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.077555] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.236242] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-c43fa67e-15af-4e9d-94e6-6d2c234a6ef3 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 724.236242] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-c43fa67e-15af-4e9d-94e6-6d2c234a6ef3 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 724.236242] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-c43fa67e-15af-4e9d-94e6-6d2c234a6ef3 service nova] Enqueued Resource ID: 0d194f08-ff26-413f-a715-1d412fee15f9 with Priority: HIGHEST for action port [ 724.236242] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 724.236997] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 724.237457] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d194f08-ff26-413f-a715-1d412fee15f9 with Priority: HIGHEST for action port [ 724.238225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.239102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.239102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.239651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.242016] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.242016] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.242016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.242016] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d194f08-ff26-413f-a715-1d412fee15f9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.242016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.242016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.242016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.242016] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d194f08-ff26-413f-a715-1d412fee15f9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.580706] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.581722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.581722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.581722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.581852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.582601] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be updated. [ 724.628628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.628987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.628987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.629068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.629243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.639248] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 724.743871] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d194f08-ff26-413f-a715-1d412fee15f9 with status ACTIVE [ 724.744166] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.744385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.744472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.744707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.744801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.744987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.745148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.745181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.745350] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.749671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.749671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.749671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.749671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.749671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.749671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.749671] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d194f08-ff26-413f-a715-1d412fee15f9 is going to be updated. [ 724.749671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.749671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.779599] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.779734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.779804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.780021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.780159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.780329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d194f08-ff26-413f-a715-1d412fee15f9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.884729] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 724.885076] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 deletion is rescheduled due to dependency. [ 724.886848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.886848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.886848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.886848] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.886848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.886848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.889032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.889032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.889032] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.391084] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.443431] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-170a0497-dffa-42c1-a61b-0c9ad897f3f6 tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 725.444505] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 725.445013] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.445283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.844784] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.845116] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.845291] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.845578] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.845845] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.846050] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.846334] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.846619] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.846809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.847135] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.847311] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.847462] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.847611] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.847868] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.848038] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.848211] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.866823] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.867044] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.867397] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.867533] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-836" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.868076] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-884fca51-92ad-4ca2-87f9-59e72d1c7564 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.868270] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.868396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.868731] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.868876] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('884fca51-92ad-4ca2-87f9-59e72d1c7564',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.893371] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.315273] env[64436]: INFO networking_nsxv3.common.synchronization [req-d86fed59-ff20-48d7-9a9c-725d9eda1ed3 req-25e164ef-a828-45a8-885f-5a15590c92ef tempest-ServersV294TestFqdnHostnames-1324617988 tempest-ServersV294TestFqdnHostnames-1324617988-project-member] Enqueued Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_members [ 726.315922] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 with Priority: HIGHEST for action security_group_members [ 726.316302] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.316498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.316697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.316986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.316986] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.317147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.317147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.317385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.317385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.317496] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.375026] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.375026] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 884fca51-92ad-4ca2-87f9-59e72d1c7564 not found, creating... [ 726.375026] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.375026] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.375623] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.375623] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.375990] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.376990] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.376990] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.376990] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 884fca51-92ad-4ca2-87f9-59e72d1c7564 is going to be created. [ 726.402130] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.402130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.402130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.402130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.402130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.402130] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 726.417027] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.417027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.417027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.417027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.417027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.417027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.441227] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.441227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.441227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.441227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.441227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.446252] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 726.649133] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 726.649402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.649844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.650113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.650335] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.650470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.650548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.650920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.650920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.650920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.651076] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.822177] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.822177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.822177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.822177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.840853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.841127] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.841265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.841346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.841550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.841636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.841825] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 is going to be updated. [ 726.866281] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.866478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.866567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.866707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.866850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.881922] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 in Status: IN_PROGRESS for 2s [ 727.155612] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.158526] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.158526] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.158526] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.158526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.159394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.159394] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.591105] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-6f3df6de-36f3-4721-9fc8-fd148fafd424 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 727.591105] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-6f3df6de-36f3-4721-9fc8-fd148fafd424 service nova] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 727.591105] env[64436]: INFO networking_nsxv3.common.synchronization [req-abc206de-306f-42dd-8f1a-8742dee71941 req-6f3df6de-36f3-4721-9fc8-fd148fafd424 service nova] Enqueued Resource ID: 884fca51-92ad-4ca2-87f9-59e72d1c7564 with Priority: HIGHEST for action port [ 727.591105] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_rules [ 727.591105] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 727.591105] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884fca51-92ad-4ca2-87f9-59e72d1c7564 with Priority: HIGHEST for action port [ 727.591105] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.591105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.591105] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.591105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.592230] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-884fca51-92ad-4ca2-87f9-59e72d1c7564 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.592230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.592230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.592230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.592230] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('884fca51-92ad-4ca2-87f9-59e72d1c7564',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.663447] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 377c820a-e6ee-48bb-9450-abc7d40a08d0: rpc.has_security_group_logging(os_id): False [ 727.680681] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.680837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.681055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.681508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.701963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.701963] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.703033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.703033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.703033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.703033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.703363] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.703634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.703717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.703923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.704201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.704463] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.704694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.704735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.704958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.705246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.705429] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be updated. [ 727.762281] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.762558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.762634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.764270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.764270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.776554] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 728.096147] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 884fca51-92ad-4ca2-87f9-59e72d1c7564 with status ACTIVE [ 728.096147] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.096147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.096147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.096147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.096147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.096147] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.096147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.096147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.096147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.097323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.097577] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.097698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.097770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.097939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.098044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.098140] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 884fca51-92ad-4ca2-87f9-59e72d1c7564 is going to be updated. [ 728.118129] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.118366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.118463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.118717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.118881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.119096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-884fca51-92ad-4ca2-87f9-59e72d1c7564" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.233610] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.233870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.234389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.234389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.234604] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.392877] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa56523e-af17-4088-acc7-1668c4944aa1 req-65cf64ba-a6e6-4066-a1ed-b57a83fd2eeb tempest-ImagesOneServerTestJSON-590332812 tempest-ImagesOneServerTestJSON-590332812-project-member] Enqueued Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_members [ 728.393504] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_members [ 728.396562] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.396758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.396838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.397153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.397451] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.397613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.397727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.397978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.398056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.398153] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.456387] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 728.456679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.456858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.457142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.457433] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.457557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.457625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.457944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.457944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.458061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.458097] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.459100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.459100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.459261] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.459364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.459449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.459805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.459805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.459905] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.737622] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.854155] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.854561] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-860" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.854796] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-860" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.855639] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-860" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.857162] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.858304] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.858911] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.859098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.859369] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.859835] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.860100] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.860397] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.860474] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.860683] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.860958] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.862017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.882622] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.882848] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.882990] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.883201] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-860" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.883531] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-a1bb68d8-a092-4bae-bd98-01f910b533f1 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.883708] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.883829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.884222] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.884773] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1bb68d8-a092-4bae-bd98-01f910b533f1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.892966] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 in Status: SUCCESS [ 728.893230] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9 deletion is rescheduled due to dependency. [ 728.893381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.902029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.902200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.902242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.902459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.902542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.902736] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.902835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.902899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.903062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.903141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.903226] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 already deleted. [ 728.903310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.962019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.962019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.962161] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.240690] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.387886] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.388242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.389137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.389137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.389137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.389137] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port a1bb68d8-a092-4bae-bd98-01f910b533f1 not found, creating... [ 729.389395] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.390025] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.390025] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.390025] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.390232] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.390468] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.390662] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.390789] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.391059] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.391232] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.391414] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: a1bb68d8-a092-4bae-bd98-01f910b533f1 is going to be created. [ 729.412375] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.412690] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.412726] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.412998] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.413274] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.413454] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.466801] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.744932] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 729.744932] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 729.792194] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 729.792194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.969653] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.969846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.969889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.970153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.970249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.970347] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 730.029620] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.029766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.029839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.030080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.030224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.038628] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 730.569774] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa56523e-af17-4088-acc7-1668c4944aa1 req-a5c5dada-4597-418e-b5b3-4b3fb2d08ed5 service nova] Enqueued Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_rules [ 730.569952] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa56523e-af17-4088-acc7-1668c4944aa1 req-a5c5dada-4597-418e-b5b3-4b3fb2d08ed5 service nova] Enqueued Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_members [ 730.570100] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa56523e-af17-4088-acc7-1668c4944aa1 req-a5c5dada-4597-418e-b5b3-4b3fb2d08ed5 service nova] Enqueued Resource ID: a1bb68d8-a092-4bae-bd98-01f910b533f1 with Priority: HIGHEST for action port [ 730.570341] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_rules [ 730.570467] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_members [ 730.570560] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1bb68d8-a092-4bae-bd98-01f910b533f1 with Priority: HIGHEST for action port [ 730.571371] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.571498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.572524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.572524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.572524] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.572829] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.572946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.573030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.573242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.573376] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.574447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.574447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.574447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.574447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.574447] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.574720] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1bb68d8-a092-4bae-bd98-01f910b533f1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.575130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.575130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.576811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.576811] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1bb68d8-a092-4bae-bd98-01f910b533f1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.715019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.715019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.715019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.715019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.729812] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 730.731298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.733779] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 730.759923] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.759923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.759923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.759923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.765747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.765747] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 730.765747] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 730.765747] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 730.800190] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.802017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.802017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.802017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.802017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.802017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 730.864723] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.864985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.864985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.865232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.865403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.865695] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 730.940530] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.940682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.940682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.940931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.941173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.941418] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 730.941515] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'23b08457-f786-4357-ae40-5bf7a012b659', '03fac5b8-8389-4c07-af7a-524dd4e4a24b', 'a495b570-59ee-467c-baf8-b41b06814023', '5fd15c78-80f8-41a8-9da0-9ebf64dbfd00', '3a7c16cc-25b5-4f14-86e6-c0818627fd71', '2392c42b-4327-4a1f-85ce-846d4a8981fc', '0f75433d-92b0-49c0-b145-a45f748925ab', '9265bbca-5d7b-479b-bdda-7812d116a191', '39b1f9d7-0460-4fa5-8bf2-270d994f79e5', '156f1116-13ef-448f-a7e6-f12ab165da73', '37fe26d6-f782-4509-b81f-40a0eeb20894', '8ef0380e-f32f-4c88-984c-a677acaaff0a', 'd4e1163d-f97e-451a-89d1-745f57f66535', 'ab78b72f-7655-492a-8135-613a26cfa217', 'f0c7f357-fb7f-4089-8ca6-73477491c51b', '6b966170-3dea-4773-8900-e7034ff19049', 'f8d51f49-2f07-4baa-93f3-f28849ea55ba', '7489998c-5de5-4c9f-ad50-b496d0a60343', '9741d578-5b29-42b0-b0b6-dfd97b1c7306', 'aeeb0085-3d91-4859-b6e8-d553406b2219', '6c2d8d81-8cc8-44df-9d77-63cb789204d8', 'ddee3b8b-6805-4cc6-99b5-47b0c8059fc3', 'f7502962-276d-43f0-96f0-2447f12d3137', 'af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9', 'cfb4c1c6-2021-458b-840f-cd83ee502c3d', '3cc5500f-a0f5-4e87-aa9b-0020789243e9', 'b915a177-2742-49be-9ca9-2dc30ee9c6ac', 'a9ef4caa-55e7-4f89-9577-78cea5744bdb', 'c2485258-5c59-4503-a9df-3f4d9b5bebdb', '3ed89fd9-eeee-4f35-9707-895a0fcd48b0', 'e04160bc-db4b-4c32-8c62-3a41769c7c95', '0477e290-dfb6-401d-bc8e-f26e35953b43', 'd1017fee-6833-4760-849a-3861937d36d9', 'a22f030d-b590-48f1-adde-d139f2aa31d4', '377c820a-e6ee-48bb-9450-abc7d40a08d0', 'c4df507f-e3c4-414d-8e32-1d9e119b190a', '73a0cec9-fcd4-4729-abd7-b50d1439753c'} {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 730.941641] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 730.995068] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.995068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.995277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.995484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.995484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.995699] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 730.995792] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 730.995872] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 730.998911] env[64436]: INFO networking_nsxv3.common.synchronization [None req-c07346c6-f135-4286-ac12-50d5fefa6531 tempest-MigrationsAdminTest-163149722 tempest-MigrationsAdminTest-163149722-project-member] Enqueued Resource ID: 283995c2-7476-49b2-8cf0-0782387b22b0 with Priority: HIGHEST for action security_group_rules [ 730.999428] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283995c2-7476-49b2-8cf0-0782387b22b0 with Priority: HIGHEST for action security_group_rules [ 730.999740] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-283995c2-7476-49b2-8cf0-0782387b22b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.999858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.999930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.000203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.000281] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('283995c2-7476-49b2-8cf0-0782387b22b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.081037] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.081037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.081037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.081785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.082727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.083908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 731.083908] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 731.083908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 731.083908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 731.083908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGH for action security_group_rules [ 731.083908] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGH for action security_group_rules [ 731.084475] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGH for action security_group_rules [ 731.084626] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGH for action security_group_rules [ 731.084717] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGH for action security_group_rules [ 731.084825] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGH for action security_group_rules [ 731.084916] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGH for action security_group_rules [ 731.085022] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGH for action security_group_rules [ 731.085126] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGH for action security_group_rules [ 731.085221] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGH for action security_group_rules [ 731.085315] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGH for action security_group_rules [ 731.085658] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGH for action security_group_rules [ 731.085831] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGH for action security_group_rules [ 731.086073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.086440] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.088644] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.088884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.089800] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1bb68d8-a092-4bae-bd98-01f910b533f1 with status ACTIVE [ 731.089800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.089800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.089800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.090138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.091818] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.091818] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.091818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.091818] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1bb68d8-a092-4bae-bd98-01f910b533f1 is going to be updated. [ 731.095239] env[64436]: INFO networking_nsxv3.common.synchronization [None req-04c64f71-0c16-418f-9fc3-6f3a2388e141 tempest-MigrationsAdminTest-163149722 tempest-MigrationsAdminTest-163149722-project-member] Enqueued Resource ID: 283995c2-7476-49b2-8cf0-0782387b22b0 with Priority: HIGHEST for action security_group_rules [ 731.096207] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283995c2-7476-49b2-8cf0-0782387b22b0 with Priority: HIGHEST for action security_group_rules [ 731.096733] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a495b570-59ee-467c-baf8-b41b06814023 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0c7f357-fb7f-4089-8ca6-73477491c51b with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGH for action security_group_rules [ 731.097838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a with Priority: HIGH for action security_group_rules [ 731.098240] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGH for action security_group_rules [ 731.098240] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGH for action security_group_rules [ 731.098324] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 with Priority: HIGH for action security_group_rules [ 731.098386] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGH for action security_group_rules [ 731.098677] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9265bbca-5d7b-479b-bdda-7812d116a191 with Priority: HIGH for action security_group_rules [ 731.098827] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGH for action security_group_rules [ 731.098961] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b with Priority: HIGH for action security_group_rules [ 731.099105] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 with Priority: HIGH for action security_group_rules [ 731.099915] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-283995c2-7476-49b2-8cf0-0782387b22b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.100081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.100344] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.100508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.100603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.100867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.101022] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.102563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a495b570-59ee-467c-baf8-b41b06814023 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.102563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.102563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.102883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.102883] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a495b570-59ee-467c-baf8-b41b06814023',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.103825] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.103825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.104013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.104678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.104678] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.104933] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0c7f357-fb7f-4089-8ca6-73477491c51b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.105757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.105757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.105757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.105757] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0c7f357-fb7f-4089-8ca6-73477491c51b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.106507] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.106652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.106756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.106943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.107065] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.108165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.109037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.109037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.109037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.109037] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.109938] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7489998c-5de5-4c9f-ad50-b496d0a60343 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.110102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.110208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.111295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.111295] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7489998c-5de5-4c9f-ad50-b496d0a60343',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.111702] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.111702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.112371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.112371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.112371] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.113177] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.113409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.113489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.113717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.113875] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.114198] env[64436]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 731.115023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.115432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.115546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.115740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.115855] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.116730] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.116987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.117107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.117316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.117426] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.118740] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ef0380e-f32f-4c88-984c-a677acaaff0a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.118740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.118985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.119246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.119505] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ef0380e-f32f-4c88-984c-a677acaaff0a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.120819] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.120819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.120819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.120819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.121054] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.122480] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.122991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.122991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.122991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.122991] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.124304] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.124304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.125465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.125465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.125465] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b1f9d7-0460-4fa5-8bf2-270d994f79e5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.125833] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.126129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.126129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.127027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.127027] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.128298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9265bbca-5d7b-479b-bdda-7812d116a191 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.128298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.128298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.128298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.128298] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9265bbca-5d7b-479b-bdda-7812d116a191',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.129969] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.129969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.129969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.129969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.129969] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.131035] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.131148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.131190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.131337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.131548] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03fac5b8-8389-4c07-af7a-524dd4e4a24b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.131679] env[64436]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 731.133728] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.133728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.133728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.133728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.133728] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fd15c78-80f8-41a8-9da0-9ebf64dbfd00',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.141111] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.141436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.141562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.141834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.142421] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.142421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.142421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.143258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.143258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.143258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.143258] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.148302] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.148302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.148563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.149697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.149697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.149697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1bb68d8-a092-4bae-bd98-01f910b533f1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.521484] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.521646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.521727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.521933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.522054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.522127] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 283995c2-7476-49b2-8cf0-0782387b22b0 already deleted. [ 731.522212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.522367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.522521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.522607] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('283995c2-7476-49b2-8cf0-0782387b22b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.595750] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.636084] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.636240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.636326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.636543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.636694] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.636790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.636852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.636998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.637097] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.637178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.637283] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.656794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.656966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.657054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.657334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.658751] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.682249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.682415] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a495b570-59ee-467c-baf8-b41b06814023 is going to be deleted. [ 731.683781] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.683906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.683971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.684195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.684370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.684479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.684567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.684730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.685408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.685525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.685616] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.694344] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.694586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.694688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.694944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.695131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.695205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.695301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.695537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.695574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.695648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.695731] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.708509] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.711170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.711335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.711609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.711802] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.711912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.711975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.712147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.712241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.712328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.712409] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.713467] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.713603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.713670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.713864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.714025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.714165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.714205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.714686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.714686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.714755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.714805] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.715728] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.715832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.715889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.716073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.716240] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.716337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.716418] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.716715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.716825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.716912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.716989] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.717807] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.717908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.717971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.718139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.718265] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.718397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.718461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.718597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.718671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.718747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.718852] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.719900] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.720039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.720089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.722182] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.722182] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.722182] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.722182] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.722182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.722783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.722783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.722783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.722783] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.723450] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.723548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.723613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.723757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.723983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.724092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.724154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.724292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.724415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.724494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.724567] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.753516] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.753691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.753760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.753973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.755711] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.755816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.757544] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.757544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.760782] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.761081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.761581] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.761678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.762409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.762503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.763205] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.763301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.764131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.764247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.770438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.770588] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7489998c-5de5-4c9f-ad50-b496d0a60343 is going to be deleted. [ 731.771475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.771674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.790638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.790771] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03fac5b8-8389-4c07-af7a-524dd4e4a24b is going to be deleted. [ 731.791759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.792918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.816947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.816947] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fd15c78-80f8-41a8-9da0-9ebf64dbfd00 is going to be deleted. [ 731.818409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.818409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.821326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.824157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.827456] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.827598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.839025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.839167] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ef0380e-f32f-4c88-984c-a677acaaff0a is going to be deleted. [ 731.840079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.840391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.855096] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.855333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.860466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.860598] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be deleted. [ 731.861626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.861858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.891228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.892426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9265bbca-5d7b-479b-bdda-7812d116a191 is going to be deleted. [ 731.893175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.896309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.956026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.956184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.965503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.965670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.967126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.967126] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0c7f357-fb7f-4089-8ca6-73477491c51b is going to be deleted. [ 731.967902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.968131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.971440] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.971547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.020387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.020387] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b1f9d7-0460-4fa5-8bf2-270d994f79e5 is going to be deleted. [ 732.021091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.021433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.021433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.021717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a495b570-59ee-467c-baf8-b41b06814023" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.021717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.021863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.021946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.022078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7489998c-5de5-4c9f-ad50-b496d0a60343" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.022558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.022752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.022839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.022997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03fac5b8-8389-4c07-af7a-524dd4e4a24b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.024246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.024399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.024448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.024586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ef0380e-f32f-4c88-984c-a677acaaff0a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.025627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.025789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.025874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.026012] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fd15c78-80f8-41a8-9da0-9ebf64dbfd00" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.026166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.026315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.026400] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.026535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.029334] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.029452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.029520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.029775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.029860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.030013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9265bbca-5d7b-479b-bdda-7812d116a191" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.060979] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 732.061225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.061393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.061611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.061794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.061913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.061986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.062198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.062285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.062385] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.096304] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.096499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.096574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.096743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.096840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.096958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0c7f357-fb7f-4089-8ca6-73477491c51b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.098395] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.098526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.098596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.098791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.098908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.098984] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 283995c2-7476-49b2-8cf0-0782387b22b0 already deleted. [ 732.099083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-283995c2-7476-49b2-8cf0-0782387b22b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.099373] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.099501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.099639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.099804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.099881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.099969] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 is going to be created. [ 732.141529] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.141697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.141744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.141972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.142148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.142249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.142320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.142493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.142741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.142741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.142890] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.142946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.142984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.143117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.143248] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.143337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.143441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.143525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.143600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.143674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.143760] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.153189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.153189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.153359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.153535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.153744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.164008] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23b08457-f786-4357-ae40-5bf7a012b659: rpc.has_security_group_logging(os_id): False [ 732.204301] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.204549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.204549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.204780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.205320] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.205320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.205320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.205320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.205499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.205499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.205647] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.205762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.205804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.205929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.206271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.206553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.206553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.206715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.206715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.206788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.206896] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.208432] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.213444] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 in Status: UNINITIALIZED for 2s [ 732.215142] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.215306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.215369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.215566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.217470] env[64436]: INFO networking_nsxv3.common.synchronization [req-1752b1b3-1f69-4c50-92eb-15be83c05d6c req-cfac97d8-6636-4d11-b182-fb82ff9aecfb tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 732.218864] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 732.219738] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.219965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.219965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.220165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.220389] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.220505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.220575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.220728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.220812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.220906] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.227368] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.396455] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.398026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.398026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.398026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.398282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.399846] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.399846] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.399846] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.399846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.400419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.400419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.400419] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.404177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.404177] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.404177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.404177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.404177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.404177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.404177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 is going to be updated. [ 732.406055] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4e1163d-f97e-451a-89d1-745f57f66535: rpc.has_security_group_logging(os_id): False [ 732.408126] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.408297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.408489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.408712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.408803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.408917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b1f9d7-0460-4fa5-8bf2-270d994f79e5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.409258] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.409367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.409422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.409610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.409773] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.410512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.410512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.410512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.410512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.410512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.410764] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.410764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.410764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.410910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.411074] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.411177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.411672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.411672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.411672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.411949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.412095] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.413821] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.415947] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.416299] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.421061] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeeb0085-3d91-4859-b6e8-d553406b2219: rpc.has_security_group_logging(os_id): False [ 732.442093] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.444915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.444915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.444915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.444915] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.444915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.464399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.464692] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.464811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.464895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.465619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.465619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.465619] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.465794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.465794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.465915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.465993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.466210] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.466293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.466357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.466518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.466592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.466674] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 732.468062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.468247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.488381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.488700] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.488847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.488895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.489106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.489189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.489277] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 is going to be updated. [ 732.492500] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.492635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.492764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.492998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.493159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.506545] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: IN_PROGRESS for 2s [ 732.562492] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.562871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.562871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.563488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.563488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.565865] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.580456] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.580456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.580456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.581413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.582879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.590898] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 732.599953] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: IN_PROGRESS for 2s [ 732.645917] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f75433d-92b0-49c0-b145-a45f748925ab: rpc.has_security_group_logging(os_id): False [ 732.709378] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9741d578-5b29-42b0-b0b6-dfd97b1c7306: rpc.has_security_group_logging(os_id): False [ 732.712010] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.712211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.712211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.712484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.713986] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab78b72f-7655-492a-8135-613a26cfa217: rpc.has_security_group_logging(os_id): False [ 732.722898] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.723063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.744532] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.744751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.745897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.746030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.765168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.765564] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.765728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.765845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.766059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.766151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.766610] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.766610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.766729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.766883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.766952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.767189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.767368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.767438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.767599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.767676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.767782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 732.768928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.769131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.769298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.769458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.769557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.769683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.769772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.769857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.770036] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 732.771156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.771774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.810171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.810171] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.810171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.810171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.810171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.810171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.810171] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.810171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.810502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.810502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.810502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.810700] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.810781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.810846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.811370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.811493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.811591] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 732.812971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.813251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.821822] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.822143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.822216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.822437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.822623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.830491] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 732.840710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.841326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.841448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.841548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.841807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.841940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.842040] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab78b72f-7655-492a-8135-613a26cfa217 is going to be updated. [ 732.893430] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.893606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.893672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.893982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.894164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.905227] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.905227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.905227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.905588] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.905655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.909359] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156f1116-13ef-448f-a7e6-f12ab165da73: rpc.has_security_group_logging(os_id): False [ 732.916201] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 732.922589] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2392c42b-4327-4a1f-85ce-846d4a8981fc: rpc.has_security_group_logging(os_id): False [ 732.924314] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b966170-3dea-4773-8900-e7034ff19049: rpc.has_security_group_logging(os_id): False [ 732.928411] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.929138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.929138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.930548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.932649] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37fe26d6-f782-4509-b81f-40a0eeb20894: rpc.has_security_group_logging(os_id): False [ 732.934035] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8d51f49-2f07-4baa-93f3-f28849ea55ba: rpc.has_security_group_logging(os_id): False [ 732.935852] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.935998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.939185] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 732.976179] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.976358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.980258] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.980937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.981584] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.981788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.984048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.984366] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.984464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.984535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.984746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.984847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.984953] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 is going to be updated. [ 732.986156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.986368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.986513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.987593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.987998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.989288] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.989503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.029510] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: IN_PROGRESS for 2s [ 733.032326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.032326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.032326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.032326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.032539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.032539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.032631] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be updated. [ 733.033868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.034794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.071443] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.078773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.079348] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.079448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.079486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.079762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.079895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.080225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.080384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.080490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.080860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.080860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.081216] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.081384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.081488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.081711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.082466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.082579] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be updated. [ 733.084227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.084477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.119487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.119487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.119487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.119487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.119487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.119487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.119487] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba is going to be updated. [ 733.120821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.120821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.129839] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.130044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.155132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.155286] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.155387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.155459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.155668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.155751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.155842] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b966170-3dea-4773-8900-e7034ff19049 is going to be updated. [ 733.157392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.157606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.157749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.194724] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.194818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.194897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.195134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.195347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.210035] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: IN_PROGRESS for 2s [ 733.212464] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.212464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.212464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.212464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.212712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.244169] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: IN_PROGRESS for 2s [ 733.247597] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: IN_PROGRESS for 2s [ 733.309478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.309660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.309733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.309988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.310166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.331545] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.331732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.331779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.332272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.332272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.355374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: IN_PROGRESS for 2s [ 733.369270] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: IN_PROGRESS for 2s [ 733.574530] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.574974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.574974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.575099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.575137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.575265] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 733.605351] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.605351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.605351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.605592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.605724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.614312] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 734.224200] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 in Status: SUCCESS [ 734.224458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.224620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.224857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.225069] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.225195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.225268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.225427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.225512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.225597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.225688] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.519275] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: SUCCESS [ 734.519489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.604026] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 734.604353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.609410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: SUCCESS [ 734.609686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.728308] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.728536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.728615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.728851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.729045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.729201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.729286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.729959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.729959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.729959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.729959] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.729959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.730358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.730358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.730358] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.730737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.730737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.730737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.730952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.730952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.731086] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.841796] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 734.841796] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 734.841796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.932337] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 734.932914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.953227] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 734.953376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.046516] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: SUCCESS [ 735.046732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.225222] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: SUCCESS [ 735.225563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.240604] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 187248ab-d2a0-4cf9-a442-d5273f2938e3: rpc.has_security_group_logging(os_id): False [ 735.262930] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.263681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.263794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.264084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.264301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.264468] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.264622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.264711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.264904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.265015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.265298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.265424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.265517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.265695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.265799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.266023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.266173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.266259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.266434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.266536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.266646] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 is going to be created. [ 735.269009] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 735.269279] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.270086] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 735.270308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.328440] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.328696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.328897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.329079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.329301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.339269] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 in Status: IN_PROGRESS for 2s [ 735.370041] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: SUCCESS [ 735.370297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.384517] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: SUCCESS [ 735.384754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.624173] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 735.624173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.624919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.624919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.624919] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.625404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.625404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.625521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.625594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.625754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.626757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.626757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.626757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.627412] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.082032] env[64436]: INFO networking_nsxv3.common.synchronization [req-99f932c2-3a19-495e-a4db-ae26a3f99298 req-ca5e30e0-0c43-4455-9569-fcda4f1461d7 tempest-ListImageFiltersTestJSON-829589829 tempest-ListImageFiltersTestJSON-829589829-project-member] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 736.083970] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 736.084360] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.084487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.084561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.084840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.084970] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.085310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.085310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.085310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.085450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.085482] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.133374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed89fd9-eeee-4f35-9707-895a0fcd48b0: rpc.has_security_group_logging(os_id): False [ 736.150328] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.150484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.154057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.154057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.169235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.169492] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.169632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.169705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.169904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.169989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.170241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.170478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.170478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.170595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.170627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.170860] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.170976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.171074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.171239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.171299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.171341] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 736.224278] env[64436]: INFO networking_nsxv3.common.synchronization [req-603eb4cd-bf92-4068-95aa-2d0d7567b6d2 req-42f427db-871b-40eb-b452-f1d73bd77ac7 tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 736.225482] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 736.225482] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.225482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.225482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.226572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.226572] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.226572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.226572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.228107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.228258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.228449] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.266024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.266024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.266024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.266260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.266472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.286436] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 736.454650] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.454798] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.454878] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.455170] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.455635] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.455635] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.455779] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.455989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.456590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.456590] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.456590] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.456590] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.456878] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.456878] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.457186] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.457186] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.489077] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.489281] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.489428] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.489646] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.489978] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-12a91844-528a-4e81-81f9-6bdc6cafd479 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.490187] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.490319] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.490649] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.490793] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a91844-528a-4e81-81f9-6bdc6cafd479',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.587980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.588202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.588815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.588815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.588815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.589047] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.589047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.589047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.589503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.589503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.589503] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a already deleted. [ 736.589679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.733130] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.733309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.733383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.733624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.757514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.757777] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.757898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.757967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.758195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.758298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.758420] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 736.785712] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.785712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.785712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.785712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.785997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.795492] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 736.994215] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.994481] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.994670] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.995102] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.995350] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.995640] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 12a91844-528a-4e81-81f9-6bdc6cafd479 not found, creating... [ 736.996051] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.996314] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.996766] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.996885] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.997017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.997413] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.997622] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.997774] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.998056] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.998254] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.998479] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 12a91844-528a-4e81-81f9-6bdc6cafd479 is going to be created. [ 737.019308] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.019529] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.019681] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.020062] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.020317] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.020557] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.351115] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 in Status: SUCCESS [ 737.351493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.900511] env[64436]: INFO networking_nsxv3.common.synchronization [req-99f932c2-3a19-495e-a4db-ae26a3f99298 req-41c480d0-2613-48b6-9326-9aaf39d89dcf service nova] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_rules [ 737.900817] env[64436]: INFO networking_nsxv3.common.synchronization [req-99f932c2-3a19-495e-a4db-ae26a3f99298 req-41c480d0-2613-48b6-9326-9aaf39d89dcf service nova] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 737.901045] env[64436]: INFO networking_nsxv3.common.synchronization [req-99f932c2-3a19-495e-a4db-ae26a3f99298 req-41c480d0-2613-48b6-9326-9aaf39d89dcf service nova] Enqueued Resource ID: 12a91844-528a-4e81-81f9-6bdc6cafd479 with Priority: HIGHEST for action port [ 737.901680] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_rules [ 737.901838] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 737.901965] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a91844-528a-4e81-81f9-6bdc6cafd479 with Priority: HIGHEST for action port [ 737.902595] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.902756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.902848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.903138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.903257] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.904852] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.905024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.905720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.906033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.906271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.906432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.909962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.910231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.910395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.910547] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.912140] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a91844-528a-4e81-81f9-6bdc6cafd479 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.912301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.912354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.912573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.912655] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a91844-528a-4e81-81f9-6bdc6cafd479',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.965802] env[64436]: INFO networking_nsxv3.common.synchronization [req-2f31a742-12ae-4cf4-8eec-6c5f8e723056 req-f7ffb2d2-f5e5-4a76-a892-42fe2c4ff427 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 737.966352] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 737.966656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.966777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.966843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.967588] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.967794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.967933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.968032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.968429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.968429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.968429] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.219469] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.219719] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.219839] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.220114] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.220421] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.220534] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.220647] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.220870] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.221292] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.221292] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.221552] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.221552] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.221552] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.221884] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.221884] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.221884] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.239278] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.239278] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.239278] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.239505] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.239857] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-62d27d7b-eba1-4308-adc1-0dc104bc395c taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.241230] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.241230] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.241230] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.241230] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62d27d7b-eba1-4308-adc1-0dc104bc395c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.305144] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 738.305285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.305496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.305741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.305834] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.414266] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.418788] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.418788] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12a91844-528a-4e81-81f9-6bdc6cafd479 with status ACTIVE [ 738.418788] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.418788] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.418788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.419317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.420176] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.420176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.420176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.420176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.420176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.420176] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12a91844-528a-4e81-81f9-6bdc6cafd479 is going to be updated. [ 738.439723] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.439723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.439723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.440178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.440178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.440178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a91844-528a-4e81-81f9-6bdc6cafd479" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.472985] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.473229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.473229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.473578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.473698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.473823] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.473942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.474038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.474138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.474216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.474291] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 already deleted. [ 738.474382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.745094] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.745333] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.745458] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.745732] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.745907] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.746133] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 62d27d7b-eba1-4308-adc1-0dc104bc395c not found, creating... [ 738.746402] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.746572] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.746692] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.746924] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.747063] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.748911] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.749117] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.749245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.749910] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.749910] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.750473] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 62d27d7b-eba1-4308-adc1-0dc104bc395c is going to be created. [ 738.768952] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.769188] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.769329] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.769666] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.769907] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.770157] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.806644] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 738.808260] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 deletion is rescheduled due to dependency. [ 738.808260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.808418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.808479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.808555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.808799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.808963] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.809107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.809174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.809343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.809435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.810112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.810112] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.882933] env[64436]: INFO networking_nsxv3.common.synchronization [req-1c7e67da-da1d-44ba-9724-9dcba07c045d req-f0d982b3-ad36-42da-be3d-bcd20face708 tempest-ServersNegativeTestJSON-1058932887 tempest-ServersNegativeTestJSON-1058932887-project-member] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 738.884211] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 738.884392] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.884556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.884635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.884893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.885090] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.885227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.885316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.885522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.885620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.885737] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.922815] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.984180] env[64436]: INFO networking_nsxv3.common.synchronization [req-38fb62a0-7c47-4484-a09d-811f0483d62f req-6e50ed09-1539-4354-a7d2-cec609b71467 tempest-ListImageFiltersTestJSON-829589829 tempest-ListImageFiltersTestJSON-829589829-project-member] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 738.984180] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 738.984180] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.984180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.312710] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.312873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.312948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.313196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.313366] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.313498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.313575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.313734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.313826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.313913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.314082] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.314176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.314237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.314378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.314515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.314606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.314666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.314804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.314878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.314956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.315241] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.390228] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.425197] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.425197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.425197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.426589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.426589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.426589] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be created. [ 739.438093] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.438426] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.438623] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.439017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.439436] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.440335] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.440565] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.440903] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.441135] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.441429] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.441712] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.441803] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.441928] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.442121] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.442273] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.442481] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.463136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.463341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.463389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.463781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.463781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.465908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.466154] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 739.466244] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.466386] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.466698] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-8736c033-cafd-485d-a4b1-34179cc44ef3 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.466903] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.467052] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.467442] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.467588] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8736c033-cafd-485d-a4b1-34179cc44ef3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.476272] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: UNINITIALIZED for 2s [ 739.548261] env[64436]: INFO networking_nsxv3.common.synchronization [req-2f31a742-12ae-4cf4-8eec-6c5f8e723056 req-6e9a8d7d-a97e-4769-b875-5968bfb028e5 service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 739.549296] env[64436]: INFO networking_nsxv3.common.synchronization [req-2f31a742-12ae-4cf4-8eec-6c5f8e723056 req-6e9a8d7d-a97e-4769-b875-5968bfb028e5 service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 739.549563] env[64436]: INFO networking_nsxv3.common.synchronization [req-2f31a742-12ae-4cf4-8eec-6c5f8e723056 req-6e9a8d7d-a97e-4769-b875-5968bfb028e5 service nova] Enqueued Resource ID: 62d27d7b-eba1-4308-adc1-0dc104bc395c with Priority: HIGHEST for action port [ 739.550299] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 739.550492] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 739.550641] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d27d7b-eba1-4308-adc1-0dc104bc395c with Priority: HIGHEST for action port [ 739.551341] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.551508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.551675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.552035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.552149] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.554213] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.554453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.554548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.554885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.555133] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.555272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.555544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.555580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.555682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.555818] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.557057] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-62d27d7b-eba1-4308-adc1-0dc104bc395c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.557218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.557347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.558046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.558046] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62d27d7b-eba1-4308-adc1-0dc104bc395c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.817533] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed89fd9-eeee-4f35-9707-895a0fcd48b0: rpc.has_security_group_logging(os_id): False [ 739.844983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.844983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.844983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.844983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.844983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.844983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.844983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.844983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.844983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.845954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.845954] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.845954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.845954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.845954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.845954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.848994] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.849186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.849326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.849497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.849607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.849729] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 739.893412] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.957873] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.958080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.958135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.958378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.958557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.970337] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.970600] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.970738] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.971062] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.971272] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.971487] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 8736c033-cafd-485d-a4b1-34179cc44ef3 not found, creating... [ 739.971819] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.972040] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.972205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.972531] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.972608] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.972961] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.973295] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.973432] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.973694] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.973840] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.973982] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 8736c033-cafd-485d-a4b1-34179cc44ef3 is going to be created. [ 739.977060] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 740.000251] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.000502] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.000627] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.000978] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.001519] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.001597] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.060591] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.060748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.060944] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.061855] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62d27d7b-eba1-4308-adc1-0dc104bc395c with status ACTIVE [ 740.065262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.065262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.065262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.065262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.065262] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62d27d7b-eba1-4308-adc1-0dc104bc395c is going to be updated. [ 740.091021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.091202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.091280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.091504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.091645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.091803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62d27d7b-eba1-4308-adc1-0dc104bc395c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.396357] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.396536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.396607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.397573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.397573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.397573] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be updated. [ 740.422029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.422220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.422263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.422450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.422615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.430512] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 740.522081] env[64436]: INFO networking_nsxv3.common.synchronization [req-ffa2fecd-40d2-4a81-996e-b2284402ec8a req-1d774e21-0463-4318-af51-be217eb909d7 tempest-ServerRescueTestJSON-102856840 tempest-ServerRescueTestJSON-102856840-project-member] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 740.522081] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 740.522081] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.522081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.525579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.525820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.526011] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.526154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.526214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.526380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.526502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.526563] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.566155] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.030496] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.069080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.070269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.070425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.070776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.070899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.071014] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be created. [ 741.095741] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.095873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.095986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.097415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.097415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.111170] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: UNINITIALIZED for 2s [ 741.120375] env[64436]: INFO networking_nsxv3.common.synchronization [req-2c2b9aa1-de37-4b57-bef4-4babce9d332e req-b808373a-02bb-4723-b412-dbf061d89b05 tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 741.122441] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 741.122649] env[64436]: INFO networking_nsxv3.common.synchronization [req-38fb62a0-7c47-4484-a09d-811f0483d62f req-c21c7fe9-9027-4e6c-a984-5292f1d91127 service nova] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_rules [ 741.122951] env[64436]: INFO networking_nsxv3.common.synchronization [req-38fb62a0-7c47-4484-a09d-811f0483d62f req-c21c7fe9-9027-4e6c-a984-5292f1d91127 service nova] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 741.123068] env[64436]: INFO networking_nsxv3.common.synchronization [req-38fb62a0-7c47-4484-a09d-811f0483d62f req-c21c7fe9-9027-4e6c-a984-5292f1d91127 service nova] Enqueued Resource ID: 8736c033-cafd-485d-a4b1-34179cc44ef3 with Priority: HIGHEST for action port [ 741.123373] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.123499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.123566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.123766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.123923] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.124035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.124153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.124285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.124328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.124411] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.125470] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_rules [ 741.125629] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 741.125734] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8736c033-cafd-485d-a4b1-34179cc44ef3 with Priority: HIGHEST for action port [ 741.126433] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.126538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.126744] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.126821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.127115] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-8736c033-cafd-485d-a4b1-34179cc44ef3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.127228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.127363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.127525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.127608] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8736c033-cafd-485d-a4b1-34179cc44ef3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.486977] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: SUCCESS [ 741.487627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.487627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.487913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.488218] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.489847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.489847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.489847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.489847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.489847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.489847] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.494020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.494020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.494020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.494020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.494020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.494020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.494020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.494020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.515521] env[64436]: INFO networking_nsxv3.common.synchronization [req-4276b6d3-3fe1-447b-ad1d-ce0874d88e40 req-63f95f93-4a07-4642-8044-cb0f95c874f4 tempest-MultipleCreateTestJSON-172184536 tempest-MultipleCreateTestJSON-172184536-project-member] Enqueued Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 741.515521] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 with Priority: HIGHEST for action security_group_members [ 741.515521] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.515521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.533333] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.627530] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.629025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8736c033-cafd-485d-a4b1-34179cc44ef3 with status ACTIVE [ 741.629705] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.629705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.629705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.629909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.630037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.630373] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.630493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.630567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.630791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.630905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.631107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.631221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.631299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.631477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.631564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.631678] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8736c033-cafd-485d-a4b1-34179cc44ef3 is going to be updated. [ 741.651055] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.651275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.651275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.651465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.651611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.651785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8736c033-cafd-485d-a4b1-34179cc44ef3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.991575] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 741.991740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.992161] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.992274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.995631] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.035972] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.036153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.036220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.036438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.036601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.036635] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 is going to be updated. [ 742.061751] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.061924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.061996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.062240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.062399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.069351] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: IN_PROGRESS for 2s [ 742.129272] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.440252] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 742.440540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.497449] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.632054] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.632331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.632331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.632509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.632612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.632713] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 742.656897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.657227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.657227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.657464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.657573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.664869] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 743.002364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.002364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.002364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.002364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.002364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.002364] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be updated. [ 743.027188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.027188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.027188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.027188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.027188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.034025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: IN_PROGRESS for 2s [ 743.120309] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 743.120549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.120715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.120940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.121227] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.121352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.121422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.121627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.121716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.121813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.121888] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.624442] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.624784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.624784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.624931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.625124] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.625411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.625411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.625667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.625667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.625667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.625774] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.625889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.625949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.626102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.626758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.626758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.626758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.626758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.626758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.626758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.626758] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.081127] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: SUCCESS [ 744.081408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.130511] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d226089-248b-47ba-bfe1-ba9fc67ca294: rpc.has_security_group_logging(os_id): False [ 744.148026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.148026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.148026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.148026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.148859] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.149150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.149338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.149580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.149759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.149956] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be created. [ 744.229025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.229025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.229025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.229025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.229025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.242275] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 744.674811] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 744.675089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.675766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.675766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.675766] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.675766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.676091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.676091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.676091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.676270] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed89fd9-eeee-4f35-9707-895a0fcd48b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.042727] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: SUCCESS [ 745.042951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.043140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.043367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.043550] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.043664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.043729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.043869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.043948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.044058] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.181575] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.181749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.181810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.182017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.182117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.182315] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.182415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.182487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.182659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.182865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.182865] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 is going to be updated. [ 745.211245] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.211408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.211481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.211695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.211842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.220894] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: IN_PROGRESS for 2s [ 745.545977] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.993574] env[64436]: INFO networking_nsxv3.common.synchronization [req-8eb1add3-277d-4f6a-81f5-f41a3992ea77 req-688ca770-e7ce-4730-853f-9a278ca12a72 tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_members [ 745.994203] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_members [ 745.994515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.994642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.994738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.994997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.999666] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.999666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.999666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.999666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.999666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.999666] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.051646] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.258130] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 746.258298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.397873] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.398100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.398100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.400018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.400018] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.400018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.400018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.400018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.400018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.400018] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.400018] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.400018] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.400018] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.400419] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.402291] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.403183] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.419992] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.419992] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.420204] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.420246] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.420594] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-fd7c9921-b839-41c5-808e-e3170a3cadac taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.420748] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.420925] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.421246] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.421483] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd7c9921-b839-41c5-808e-e3170a3cadac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.506662] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.506662] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.506662] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca0f983-827d-4279-9163-19aa19101851 already deleted. [ 746.506662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.557215] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.557488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.557606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.557854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.557961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.558111] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be updated. [ 746.585343] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.585492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.585492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.585706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.585933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.603703] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: IN_PROGRESS for 2s [ 746.647218] env[64436]: INFO networking_nsxv3.common.synchronization [req-77aa12c8-ec4a-4369-99e3-e03aa9559822 req-f562b535-d123-451d-949d-2d314f42ac2d tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_members [ 746.647430] env[64436]: INFO networking_nsxv3.common.synchronization [req-77aa12c8-ec4a-4369-99e3-e03aa9559822 req-f562b535-d123-451d-949d-2d314f42ac2d tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 746.647580] env[64436]: INFO networking_nsxv3.common.synchronization [req-77aa12c8-ec4a-4369-99e3-e03aa9559822 req-f562b535-d123-451d-949d-2d314f42ac2d tempest-SecurityGroupsTestJSON-1399429926 tempest-SecurityGroupsTestJSON-1399429926-project-member] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 746.648190] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c with Priority: HIGHEST for action security_group_members [ 746.648344] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGHEST for action security_group_members [ 746.648526] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGHEST for action security_group_members [ 746.648742] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-73a0cec9-fcd4-4729-abd7-b50d1439753c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.648889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.648957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.649173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.649368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.649508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.649586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.649739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.649854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.649945] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73a0cec9-fcd4-4729-abd7-b50d1439753c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.653939] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.653939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.653939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.653939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.653939] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.653939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.653939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.653939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.653939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.653939] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.653939] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.654642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.654642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.654642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.654642] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.654642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.654642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.654911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.654911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.654911] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.926310] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.926310] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.926805] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.926805] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.927083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.927851] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port fd7c9921-b839-41c5-808e-e3170a3cadac not found, creating... [ 746.927851] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.928651] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.928651] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.929080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.929435] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.930645] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.931124] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.931545] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.931996] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.932285] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.932555] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: fd7c9921-b839-41c5-808e-e3170a3cadac is going to be created. [ 746.957298] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.957952] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.958115] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.958347] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.958615] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.958877] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.124550] env[64436]: INFO networking_nsxv3.common.synchronization [req-c1eb0d90-e13d-4a6a-b6db-32bbd3d5af35 req-f48c67a9-1bcd-44e3-8ddf-66cf886cc750 tempest-ServersTestFqdnHostnames-248546948 tempest-ServersTestFqdnHostnames-248546948-project-member] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_members [ 747.126507] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGHEST for action security_group_members [ 747.126928] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.127093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.127159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.127384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.127623] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.127755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.127821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.128018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.128409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.128409] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.152418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.153030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.153030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.153030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.154593] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.154717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.157641] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.157789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.175053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.175053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.175053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.175053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.175053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.175053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.175053] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c is going to be updated. [ 747.176426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.179398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.216173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.216173] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.216173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.216173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.216173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.216173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.216173] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be updated. [ 747.217766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.218560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.218560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.218984] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.219187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.219334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.219559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.219737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.220656] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be updated. [ 747.225636] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.225828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.225949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.226327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.226482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.242273] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: IN_PROGRESS for 2s [ 747.243562] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 in Status: SUCCESS [ 747.243742] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed89fd9-eeee-4f35-9707-895a0fcd48b0 deletion is rescheduled due to dependency. [ 747.243858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed89fd9-eeee-4f35-9707-895a0fcd48b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.262285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.262285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.262285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.262285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.262285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.269639] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.269639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.269639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.269639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.269639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.277542] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: IN_PROGRESS for 2s [ 747.278326] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: IN_PROGRESS for 2s [ 747.633188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.633372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.633448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.634451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.634451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.635063] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.635213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.635333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.635615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.635704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.635870] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b966170-3dea-4773-8900-e7034ff19049 is going to be updated. [ 747.663355] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.663355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.663355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.663355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.663355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.672771] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: IN_PROGRESS for 2s [ 747.943178] env[64436]: INFO networking_nsxv3.common.synchronization [req-8eb1add3-277d-4f6a-81f5-f41a3992ea77 req-33ba5c83-dcbe-4504-970f-c6909985ce64 service nova] Enqueued Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_rules [ 747.943758] env[64436]: INFO networking_nsxv3.common.synchronization [req-8eb1add3-277d-4f6a-81f5-f41a3992ea77 req-33ba5c83-dcbe-4504-970f-c6909985ce64 service nova] Enqueued Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_members [ 747.943758] env[64436]: INFO networking_nsxv3.common.synchronization [req-8eb1add3-277d-4f6a-81f5-f41a3992ea77 req-33ba5c83-dcbe-4504-970f-c6909985ce64 service nova] Enqueued Resource ID: fd7c9921-b839-41c5-808e-e3170a3cadac with Priority: HIGHEST for action port [ 747.944009] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_rules [ 747.944009] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_members [ 747.944118] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7c9921-b839-41c5-808e-e3170a3cadac with Priority: HIGHEST for action port [ 747.944742] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.944927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.944969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.945735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.945735] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.948026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.948026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.948026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.948026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.948026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.948026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.948026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.948026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.948026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.948413] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.951264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd7c9921-b839-41c5-808e-e3170a3cadac taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.951264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.951264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.951264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.951264] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd7c9921-b839-41c5-808e-e3170a3cadac',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.452509] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.452509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.452509] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.453612] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd7c9921-b839-41c5-808e-e3170a3cadac with status ACTIVE [ 748.453612] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.453748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.453784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.453977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.454081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.454370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.454520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.454589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.454760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.454843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.455096] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.455179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.455227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.455369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.455572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.455572] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd7c9921-b839-41c5-808e-e3170a3cadac is going to be updated. [ 748.475515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.475515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.475776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.475776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.475894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.476102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd7c9921-b839-41c5-808e-e3170a3cadac" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.615727] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: SUCCESS [ 748.616090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.616340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.616653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.616966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.617161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.617275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.617529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.617657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.617811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.619100] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.619282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.619413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.619565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.619783] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.619906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.619988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.620204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.620318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.620449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.620498] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.957566] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.122749] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a: rpc.has_security_group_logging(os_id): False [ 749.140980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.141247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.141349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.141676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.141775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.141991] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.142147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.142207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.142435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.142435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.142618] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.142714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.142775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.142921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.145203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.145505] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.145662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.145714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.145843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.145930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.146054] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be created. [ 749.213686] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.213686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.213686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.213686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.213686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.224039] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: IN_PROGRESS for 2s [ 749.260320] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c in Status: SUCCESS [ 749.260596] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73a0cec9-fcd4-4729-abd7-b50d1439753c deletion is rescheduled due to dependency. [ 749.260681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73a0cec9-fcd4-4729-abd7-b50d1439753c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.288709] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 in Status: SUCCESS [ 749.289412] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 deletion is rescheduled due to dependency. [ 749.289572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.290389] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 in Status: SUCCESS [ 749.290557] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 deletion is rescheduled due to dependency. [ 749.290658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.455032] env[64436]: INFO networking_nsxv3.common.synchronization [req-c664b853-87b0-4c8a-89a4-9a83a8a65db0 req-ff59014b-75a9-4cb9-9f7d-bb18e005aa89 tempest-ServersTestBootFromVolume-1864235061 tempest-ServersTestBootFromVolume-1864235061-project-member] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_members [ 749.455661] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGHEST for action security_group_members [ 749.455987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.456486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.456486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.457494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.457494] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.457494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.457494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.457494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.457494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.457494] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.461277] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.461410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.461485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.461780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.461846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.461900] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca0f983-827d-4279-9163-19aa19101851 is going to be created. [ 749.487496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.487725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.487846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.488203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.488480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.498910] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca0f983-827d-4279-9163-19aa19101851 in Status: UNINITIALIZED for 2s [ 749.683251] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b966170-3dea-4773-8900-e7034ff19049 in Status: SUCCESS [ 749.683251] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b966170-3dea-4773-8900-e7034ff19049 deletion is rescheduled due to dependency. [ 749.683251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.946317] env[64436]: INFO networking_nsxv3.common.synchronization [req-86e26d57-e785-434d-8a1e-cc277270464e req-6bbbaba7-1278-4d91-8bed-df50665d565c tempest-ServersWithSpecificFlavorTestJSON-1646558451 tempest-ServersWithSpecificFlavorTestJSON-1646558451-project-member] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 749.950032] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 749.950032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.950032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.950032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.950032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.950369] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.950369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.950369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.950503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.950503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.950628] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.959447] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.959630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.959715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.959935] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.960041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.960284] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.962020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.962020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.962020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.962020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.962274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 is going to be updated. [ 749.992845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.993022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.993146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.993322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.993464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.004274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: IN_PROGRESS for 2s [ 750.454536] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.454905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.455154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.455442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.455442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.455651] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.455774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.455839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.456074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.456168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.456168] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be updated. [ 750.485229] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.485229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.485229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.485229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.485229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.492266] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: IN_PROGRESS for 2s [ 750.535792] env[64436]: INFO networking_nsxv3.common.synchronization [req-a8d03955-db16-4c5e-929b-48cf9e3b5da7 req-243ff096-a7d5-473a-804c-0b2611e33467 tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 750.536353] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 750.536669] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.536792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.536859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.537114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.537278] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.537403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.537534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.537683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.537805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.537927] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.040789] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.235028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: SUCCESS [ 751.235246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.235435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.236706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.236706] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.325023] env[64436]: INFO networking_nsxv3.common.synchronization [req-47c23568-d4f8-44c6-8fb6-6ec9e0202e6b req-789695eb-d96e-45f9-8d35-a4c6142dd3f8 tempest-ServerActionsV293TestJSON-1533962128 tempest-ServerActionsV293TestJSON-1533962128-project-member] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_members [ 751.326405] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGHEST for action security_group_members [ 751.326745] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.326898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.326969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.327222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.327398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.327585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.327641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.327834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.327914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.328036] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.514811] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca0f983-827d-4279-9163-19aa19101851 in Status: SUCCESS [ 751.515113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.515243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.515595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.515814] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.515931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.515996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.516170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.516266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.518786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.518786] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.543499] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.738856] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.739149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.739270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.739551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.739813] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.739972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.740063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.740292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.740434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.740580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.740714] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.830813] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.830973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.831076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.831304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.831425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.831642] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.831743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.831810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.832047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.832164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.832256] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba is going to be updated. [ 751.857342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.857573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.857644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.857876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.858031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.869234] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: IN_PROGRESS for 2s [ 752.015177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156f1116-13ef-448f-a7e6-f12ab165da73 in Status: SUCCESS [ 752.015566] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 deletion is rescheduled due to dependency. [ 752.015566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.021406] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.045994] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.046215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.046260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.046450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.046573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.046632] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 752.074855] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.076207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.076207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.076207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.076207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.085094] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 752.245518] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.247781] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.247781] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.247781] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.248721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.248721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.248721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.248874] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.377205] env[64436]: INFO networking_nsxv3.common.synchronization [req-40938250-7f05-4bcd-a35c-869326d541d7 req-75f27494-68fb-438c-a1f3-f8b774d46201 tempest-ServersTestManualDisk-1492175432 tempest-ServersTestManualDisk-1492175432-project-member] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_members [ 752.377941] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGHEST for action security_group_members [ 752.378315] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.378474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.378549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.378802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.378977] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.379080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.379135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.379305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.379429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.379491] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.511021] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 752.511021] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc deletion is rescheduled due to dependency. [ 752.511021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.523766] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ca0f983-827d-4279-9163-19aa19101851: rpc.has_security_group_logging(os_id): False [ 752.544031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.544031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.544031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.544031] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca0f983-827d-4279-9163-19aa19101851 is going to be created. [ 752.612278] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.612398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.612490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.612699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.612893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.623967] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca0f983-827d-4279-9163-19aa19101851 in Status: IN_PROGRESS for 2s [ 752.752420] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a: rpc.has_security_group_logging(os_id): False [ 752.775279] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.775506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.775557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.776514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.776514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.776514] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.776514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.776514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.776964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.776964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.776964] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.777173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.777173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.777250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.778679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.778679] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.778679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.778679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.778679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.778679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.778679] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be updated. [ 752.845929] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.846294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.846294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.846568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.846568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.860197] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: IN_PROGRESS for 2s [ 752.883017] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.883208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.883282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.883539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.883625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.884588] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.884757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.884833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.885095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.885272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.885405] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 is going to be updated. [ 752.927675] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.927675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.928036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.928220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.928401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.939402] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: IN_PROGRESS for 2s [ 753.783311] env[64436]: INFO networking_nsxv3.common.synchronization [req-87b7fb8e-704a-4dbb-b8fc-f5b654f9a9ab req-4a6040f0-7cf0-4206-b518-55ecb721906b tempest-MigrationsAdminTest-163149722 tempest-MigrationsAdminTest-163149722-project-member] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 753.783311] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 753.783311] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.783311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.783311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.783311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.783311] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.784213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.784421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.784727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.784921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.785127] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.879612] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba in Status: SUCCESS [ 753.880121] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba deletion is rescheduled due to dependency. [ 753.880250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.082786] env[64436]: INFO networking_nsxv3.common.synchronization [None req-6252cccf-6e1d-4ff2-ba6a-e2f20a9793d4 None None] Enqueued Resource ID: f312572e-87c1-4e35-8fdf-128acf16647e with Priority: HIGHEST for action port [ 754.083344] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f312572e-87c1-4e35-8fdf-128acf16647e with Priority: HIGHEST for action port [ 754.083656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-f312572e-87c1-4e35-8fdf-128acf16647e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.083783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f312572e-87c1-4e35-8fdf-128acf16647e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.083851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f312572e-87c1-4e35-8fdf-128acf16647e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.088301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f312572e-87c1-4e35-8fdf-128acf16647e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.088526] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f312572e-87c1-4e35-8fdf-128acf16647e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.098232] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 754.098232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.120458] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.120944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.121995] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.122427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.123809] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.123809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.123809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.123809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.123809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.124187] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.124187] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.124286] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.124502] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.124561] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.124640] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.124935] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.142852] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.143292] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.143582] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.143708] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.143946] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.144143] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.144347] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.144752] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.145067] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f7baecc-ddee-4ec2-bfc8-c318a81128cc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.287762] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.592312] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f312572e-87c1-4e35-8fdf-128acf16647e [ 754.593072] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.593072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.593072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.593341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.593445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.593631] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f312572e-87c1-4e35-8fdf-128acf16647e already deleted. [ 754.593824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f312572e-87c1-4e35-8fdf-128acf16647e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.635468] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca0f983-827d-4279-9163-19aa19101851 in Status: SUCCESS [ 754.635644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.648967] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.649460] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.649460] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.650232] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.650232] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.650232] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 4f7baecc-ddee-4ec2-bfc8-c318a81128cc not found, creating... [ 754.651641] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.651641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.651641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.651641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.651641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.651918] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.652231] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.652394] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.652811] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.653352] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.653352] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 4f7baecc-ddee-4ec2-bfc8-c318a81128cc is going to be created. [ 754.682774] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.683088] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.683535] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.683535] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.684278] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.684278] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.790205] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.880784] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: SUCCESS [ 754.881728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.949721] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4e1163d-f97e-451a-89d1-745f57f66535 in Status: SUCCESS [ 754.949721] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 deletion is rescheduled due to dependency. [ 754.949721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.293046] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.293243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.293313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.293540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.293631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.293735] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be updated. [ 755.319975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.319975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.320249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.320353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.320503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.329354] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: IN_PROGRESS for 2s [ 755.551350] env[64436]: INFO networking_nsxv3.common.synchronization [req-87b7fb8e-704a-4dbb-b8fc-f5b654f9a9ab req-90726c9b-967f-418b-af5a-56992215091b service nova] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_rules [ 755.551531] env[64436]: INFO networking_nsxv3.common.synchronization [req-87b7fb8e-704a-4dbb-b8fc-f5b654f9a9ab req-90726c9b-967f-418b-af5a-56992215091b service nova] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 755.551679] env[64436]: INFO networking_nsxv3.common.synchronization [req-87b7fb8e-704a-4dbb-b8fc-f5b654f9a9ab req-90726c9b-967f-418b-af5a-56992215091b service nova] Enqueued Resource ID: 4f7baecc-ddee-4ec2-bfc8-c318a81128cc with Priority: HIGHEST for action port [ 755.551917] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_rules [ 755.552056] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 755.552156] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7baecc-ddee-4ec2-bfc8-c318a81128cc with Priority: HIGHEST for action port [ 755.552735] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.552856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.552928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.553359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.553451] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.554465] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.554585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.554773] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.554942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.554942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.555142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.555217] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f7baecc-ddee-4ec2-bfc8-c318a81128cc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.559417] env[64436]: INFO networking_nsxv3.common.synchronization [req-db467849-37fd-407a-8f8c-e896e3cda100 req-1c6fd459-7512-483a-85cc-c43ee6f8f296 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 755.559836] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 755.560184] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.560364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.560404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.560563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.560717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.560815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.560877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.561039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.561125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.561225] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.918495] env[64436]: INFO networking_nsxv3.common.synchronization [None req-431c947c-7e11-414a-929a-68d25956b5da None None] Enqueued Resource ID: 8225f444-8f9f-43cf-b466-92c7d75117d3 with Priority: HIGHEST for action port [ 755.918744] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8225f444-8f9f-43cf-b466-92c7d75117d3 with Priority: HIGHEST for action port [ 755.919338] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-8225f444-8f9f-43cf-b466-92c7d75117d3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.919472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8225f444-8f9f-43cf-b466-92c7d75117d3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.919540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8225f444-8f9f-43cf-b466-92c7d75117d3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.919819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8225f444-8f9f-43cf-b466-92c7d75117d3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.919914] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8225f444-8f9f-43cf-b466-92c7d75117d3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.058764] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f7baecc-ddee-4ec2-bfc8-c318a81128cc with status ACTIVE [ 756.060222] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.061064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.061967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.061967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.061967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.061967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.061967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.061967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.062362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.062362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.062516] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.062616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.062682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.062826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.062902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.062988] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f7baecc-ddee-4ec2-bfc8-c318a81128cc is going to be updated. [ 756.064642] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.064740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.065023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.065387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.065387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.065387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.065501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.065595] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.065693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.065757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.065896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.065976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.066350] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 756.087563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.087563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.087563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.087563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.087563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.087899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f7baecc-ddee-4ec2-bfc8-c318a81128cc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.103157] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.103309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.103368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.103579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.103723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.114375] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 756.424020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8225f444-8f9f-43cf-b466-92c7d75117d3 [ 756.424020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.424020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.424020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.424020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.424020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.424020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8225f444-8f9f-43cf-b466-92c7d75117d3 already deleted. [ 756.424020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8225f444-8f9f-43cf-b466-92c7d75117d3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.340194] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 757.340492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.340661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.340885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.341092] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.341214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.341283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.341429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.341519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.341612] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.844562] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.124117] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 4s [ 758.347658] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.851968] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.853074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.853074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.853074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.853074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.853074] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be updated. [ 758.904856] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.904856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.904856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.905465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.905465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.913752] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: IN_PROGRESS for 2s [ 759.880038] env[64436]: INFO networking_nsxv3.common.synchronization [req-461db0f0-7023-4f2f-9c83-b0f33bd46603 req-5050302c-c536-4987-a5c2-11124c252f5d tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 759.881140] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 759.883828] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.884033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.884135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.884410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.884628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.884750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.885749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.885749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.885749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.885749] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.132867] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 760.136468] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 deletion is rescheduled due to dependency. [ 760.136468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.388558] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.388759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.388850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.389545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.389545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.389545] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.389545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.389545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.391243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.391243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.391243] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 760.415890] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.416136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.416136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.416320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.416463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.425189] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 760.753717] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.753908] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.754636] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.754636] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.754838] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.754838] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.755024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.755576] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.755707] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.756046] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.756046] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.756223] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.756265] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.756992] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.756992] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.756992] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.774650] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.774834] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 760.774981] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.775195] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.775534] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ce11edf5-d021-4974-99b9-c7c4a3c28a72 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.775821] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.775908] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.776366] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.776456] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce11edf5-d021-4974-99b9-c7c4a3c28a72',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.838434] env[64436]: INFO networking_nsxv3.common.synchronization [req-add635e3-de41-42d3-9acc-103a68b49571 req-4a3fe7fd-ff4b-4d27-8eb3-9ae57fe12bf5 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_members [ 760.839604] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGHEST for action security_group_members [ 760.839973] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.840352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.840352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.840505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.840669] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.840804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.840895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.841110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.841233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.841381] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.924993] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 760.925261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.925798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.926034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.926226] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.926381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.926477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.926641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.926729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.926816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.926907] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.281293] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.281293] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.281293] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.281618] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.281618] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.281618] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ce11edf5-d021-4974-99b9-c7c4a3c28a72 not found, creating... [ 761.281910] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.282084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.282204] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.282518] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.282672] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.282965] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.285720] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.285720] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.285720] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.285720] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.285720] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ce11edf5-d021-4974-99b9-c7c4a3c28a72 is going to be created. [ 761.307454] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.307718] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.307874] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.308185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.308442] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.308782] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.345233] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.345233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.345345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.345573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.345719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.345926] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.346050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.346149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.346346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.346435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.346540] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab78b72f-7655-492a-8135-613a26cfa217 is going to be updated. [ 761.378103] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.378103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.378103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.378103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.378103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.389600] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: IN_PROGRESS for 2s [ 761.429313] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.429541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.429604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.430015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.430015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.430171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.430209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.430356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.430476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.430548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.430710] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.430811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.430885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.431040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.431202] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.431321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.431358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.431505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.431630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.431741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.431832] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.934250] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37fe26d6-f782-4509-b81f-40a0eeb20894: rpc.has_security_group_logging(os_id): False [ 761.960785] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.960785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.960785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.961112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.961112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.961112] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.961232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.961310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.961395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.961476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.961669] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.961769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.961833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.961974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.962062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.962247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.962339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.962399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.962537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.962612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.962698] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be updated. [ 762.023301] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.023301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.023562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.023562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.023795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.037073] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: IN_PROGRESS for 2s [ 762.051740] env[64436]: INFO networking_nsxv3.common.synchronization [req-461db0f0-7023-4f2f-9c83-b0f33bd46603 req-6c418eb5-5ca3-4c7d-9636-9802df302ae9 service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 762.053018] env[64436]: INFO networking_nsxv3.common.synchronization [req-461db0f0-7023-4f2f-9c83-b0f33bd46603 req-6c418eb5-5ca3-4c7d-9636-9802df302ae9 service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 762.053018] env[64436]: INFO networking_nsxv3.common.synchronization [req-461db0f0-7023-4f2f-9c83-b0f33bd46603 req-6c418eb5-5ca3-4c7d-9636-9802df302ae9 service nova] Enqueued Resource ID: ce11edf5-d021-4974-99b9-c7c4a3c28a72 with Priority: HIGHEST for action port [ 762.053018] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 762.053018] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 762.053018] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce11edf5-d021-4974-99b9-c7c4a3c28a72 with Priority: HIGHEST for action port [ 762.053245] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.053245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.053245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.053491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.053619] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.054987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.054987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.054987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce11edf5-d021-4974-99b9-c7c4a3c28a72 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.055166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.055166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.055349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.055423] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce11edf5-d021-4974-99b9-c7c4a3c28a72',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.437184] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 762.437366] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 deletion is rescheduled due to dependency. [ 762.437479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.437670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.437875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.439610] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.439610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.439610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.439824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.439824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.439824] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.557602] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.557785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.557841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce11edf5-d021-4974-99b9-c7c4a3c28a72 with status ACTIVE [ 762.558028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.558150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.558208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.558391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.558495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.558668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.558765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.558870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.558970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.559060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.559233] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.559327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.559380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.559507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.559579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.559662] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce11edf5-d021-4974-99b9-c7c4a3c28a72 is going to be updated. [ 762.593045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.593208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.593270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.593557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.593710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.593881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce11edf5-d021-4974-99b9-c7c4a3c28a72" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.942372] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.398812] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab78b72f-7655-492a-8135-613a26cfa217 in Status: SUCCESS [ 763.399012] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab78b72f-7655-492a-8135-613a26cfa217 deletion is rescheduled due to dependency. [ 763.399157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.446759] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.949416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.949834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.949834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.949992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.950112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.950241] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 763.976306] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.977138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.977138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.977138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.977266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.984996] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 764.049747] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 764.049968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.995152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 765.995654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.995654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.995770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.996253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.996253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.996253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.996456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.996456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.996546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.996581] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.498449] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.498568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.498675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.498933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.499140] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.501042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.501042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.501042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.501042] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.007285] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a22f030d-b590-48f1-adde-d139f2aa31d4: rpc.has_security_group_logging(os_id): False [ 767.023810] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.024130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.024224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.024485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.024613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.024845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.024958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.025041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.025207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.025322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.025517] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.025598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.025634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.025757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.025830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.026031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.026125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.026186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.026323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.026394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.026475] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 767.053758] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 767.053915] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 767.081295] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.081447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.081519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.081753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.081925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.094451] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 768.075503] env[64436]: INFO networking_nsxv3.common.synchronization [req-ffabf150-51d8-4b9b-88c4-f45162022df3 req-a8695124-71a8-48cb-a4d0-a8983c926db6 tempest-ServerRescueTestJSON-102856840 tempest-ServerRescueTestJSON-102856840-project-member] Enqueued Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 768.076868] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 with Priority: HIGHEST for action security_group_members [ 768.076868] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e04160bc-db4b-4c32-8c62-3a41769c7c95 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.077046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.077046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.077235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.077387] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.077484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.077546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.077719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.077831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.077884] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e04160bc-db4b-4c32-8c62-3a41769c7c95',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.580852] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.582249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.582962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.583425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.604442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.604875] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.605025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.605123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.606048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.606048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.606048] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 is going to be updated. [ 768.638718] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.638931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.639043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.639298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.639465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.647858] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: IN_PROGRESS for 2s [ 769.107481] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 769.107895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.633523] env[64436]: INFO networking_nsxv3.common.synchronization [req-67d4b1ff-82c8-4b49-8b72-dad0fbe235b6 req-66aa1914-9276-4c18-b3ea-4b7df6f13bb7 tempest-VolumesAssistedSnapshotsTest-817485114 tempest-VolumesAssistedSnapshotsTest-817485114-project-member] Enqueued Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_members [ 770.634299] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 with Priority: HIGHEST for action security_group_members [ 770.634729] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc5500f-a0f5-4e87-aa9b-0020789243e9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.634860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.634927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.635221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.635450] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.635597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.635597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.635947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.635947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.636032] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc5500f-a0f5-4e87-aa9b-0020789243e9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.660442] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 in Status: SUCCESS [ 770.660649] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e04160bc-db4b-4c32-8c62-3a41769c7c95 deletion is rescheduled due to dependency. [ 770.661403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e04160bc-db4b-4c32-8c62-3a41769c7c95" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.138370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.138676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.138676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.138825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.161951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.162148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.162314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.162314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.162604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.162604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.162793] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 is going to be updated. [ 771.189418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.189968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.189968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.190354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.190354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.198044] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 in Status: IN_PROGRESS for 2s [ 773.209165] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 in Status: SUCCESS [ 773.209509] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc5500f-a0f5-4e87-aa9b-0020789243e9 deletion is rescheduled due to dependency. [ 773.209509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc5500f-a0f5-4e87-aa9b-0020789243e9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.142887] env[64436]: INFO networking_nsxv3.common.synchronization [req-bacaf2f6-5a92-477b-a3a9-eb57f03048db req-7c6dc1ec-6f79-4689-9ef6-ec4749453fc8 tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 774.143514] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 774.144592] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.144723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.144798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.145103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.145270] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.145401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.145451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.145936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.145936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.145936] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.452971] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.453326] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.453386] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.453653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.453913] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.454111] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.454252] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.454479] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.454649] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.454884] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.455012] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.455156] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.455270] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.455399] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.455526] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.455677] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.473586] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.474282] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.474282] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.474282] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-689" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.474492] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-5e51cb56-1868-4f04-bee0-689c3ea17f40 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.474703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.474872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.475266] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.475443] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e51cb56-1868-4f04-bee0-689c3ea17f40',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.648073] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.648287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.648410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.648786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.648945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.649236] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.649418] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.649524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.650450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.650450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.650450] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be deleted. [ 774.678217] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.678466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.678578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.678915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.679082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.679253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.979033] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.979311] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.979412] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.979718] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.979879] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.980054] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 5e51cb56-1868-4f04-bee0-689c3ea17f40 not found, creating... [ 774.980322] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.980489] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.980610] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.980876] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.981029] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.981317] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.981474] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.981594] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.981803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.981944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.982101] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 5e51cb56-1868-4f04-bee0-689c3ea17f40 is going to be created. [ 775.007167] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.007460] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.007572] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.007946] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.008229] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.008544] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.733087] env[64436]: INFO networking_nsxv3.common.synchronization [req-bacaf2f6-5a92-477b-a3a9-eb57f03048db req-5c5c3748-925c-413a-9e60-aa378b0e8924 service nova] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_rules [ 775.733390] env[64436]: INFO networking_nsxv3.common.synchronization [req-bacaf2f6-5a92-477b-a3a9-eb57f03048db req-5c5c3748-925c-413a-9e60-aa378b0e8924 service nova] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 775.733518] env[64436]: INFO networking_nsxv3.common.synchronization [req-bacaf2f6-5a92-477b-a3a9-eb57f03048db req-5c5c3748-925c-413a-9e60-aa378b0e8924 service nova] Enqueued Resource ID: 5e51cb56-1868-4f04-bee0-689c3ea17f40 with Priority: HIGHEST for action port [ 775.734186] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_rules [ 775.734271] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 775.734393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e51cb56-1868-4f04-bee0-689c3ea17f40 with Priority: HIGHEST for action port [ 775.734760] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.734864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.734945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.735217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.735312] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.736359] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.736534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.736591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.736793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.736965] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.737147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.737225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.737394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.737488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.737598] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.738696] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e51cb56-1868-4f04-bee0-689c3ea17f40 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.738820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.738904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.739057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.739143] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e51cb56-1868-4f04-bee0-689c3ea17f40',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.241375] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.241469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.241915] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.242944] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e51cb56-1868-4f04-bee0-689c3ea17f40 with status ACTIVE [ 776.243205] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.243368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.243464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.243726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.243872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.244101] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.244240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.244358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.244593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.244705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.244929] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.245116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.245217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.245662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.245662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.245662] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e51cb56-1868-4f04-bee0-689c3ea17f40 is going to be updated. [ 776.265406] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.265406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.265652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.265709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.265860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.266047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e51cb56-1868-4f04-bee0-689c3ea17f40" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.748404] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.251229] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.251821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.251985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.252494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.252947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.253541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be created. [ 777.277777] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.278806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.278806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.279167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.279776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.290555] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: UNINITIALIZED for 2s [ 779.302995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.306064] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.306064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.306064] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.807362] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.807623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.807623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.807962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.808168] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.808277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.808344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.808525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.808627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.808712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.808894] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.809031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.809031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.809270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.809423] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.809534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.809601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.809720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.809813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.809899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.809982] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.313438] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a7c16cc-25b5-4f14-86e6-c0818627fd71: rpc.has_security_group_logging(os_id): False [ 780.335482] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.335482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.335482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.336042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.336135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.336362] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.337468] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.337468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.338267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.338267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.338267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.338267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.338267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.338498] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be created. [ 780.394637] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.394637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.394637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.394837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.395757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.406489] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 780.736689] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 780.736689] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 782.418533] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 782.418839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.914371] env[64436]: INFO networking_nsxv3.common.synchronization [req-11034d26-b628-43e1-9e2d-26b3623ede53 req-88a536f4-0b85-47ae-a746-f49c99235e18 tempest-ImagesOneServerTestJSON-590332812 tempest-ImagesOneServerTestJSON-590332812-project-member] Enqueued Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_members [ 782.916070] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGHEST for action security_group_members [ 782.916536] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.916689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.916761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.917036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.917250] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.917369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.917431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.917629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.917672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.917772] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.968022] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6538532-12c3-446d-9b87-832be9d329cf req-de8563a1-659e-488b-82b2-9241cca22cde tempest-ServersWithSpecificFlavorTestJSON-1646558451 tempest-ServersWithSpecificFlavorTestJSON-1646558451-project-member] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 782.968022] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 782.969749] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.969909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.969988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.970288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.970471] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.970576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.970653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.970818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.970902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.971029] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.098547] env[64436]: INFO networking_nsxv3.common.synchronization [None req-cb580749-81b6-48b9-bcb9-a37aff682b25 None None] Enqueued Resource ID: 975cda98-7ce9-4069-92ef-1a3ad541cec2 with Priority: HIGHEST for action port [ 783.099030] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975cda98-7ce9-4069-92ef-1a3ad541cec2 with Priority: HIGHEST for action port [ 783.100117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-975cda98-7ce9-4069-92ef-1a3ad541cec2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.100117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-975cda98-7ce9-4069-92ef-1a3ad541cec2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.100117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-975cda98-7ce9-4069-92ef-1a3ad541cec2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.100117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-975cda98-7ce9-4069-92ef-1a3ad541cec2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.102082] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('975cda98-7ce9-4069-92ef-1a3ad541cec2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.382771] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-970 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.382976] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.383121] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.383445] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.385588] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.385807] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.385935] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.386169] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.386328] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.386555] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 783.386677] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.386792] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.386908] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.387029] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 783.387144] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.387282] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.404076] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.404268] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 783.404413] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.404595] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-970" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.404919] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-6a88cc7e-f210-4884-826d-46dad9672ce6 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.405138] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.405264] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.405573] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.405779] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a88cc7e-f210-4884-826d-46dad9672ce6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.422659] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.422992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.422992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.423349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.423476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.423672] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.423780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.423825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.424021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.424095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.424182] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 is going to be updated. [ 783.450253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.450561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.450561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.450722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.450837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.459156] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 in Status: IN_PROGRESS for 2s [ 783.474051] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.474366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.474366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.474642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.474642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.474745] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.474833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.474898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.475109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.475236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.475333] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be updated. [ 783.498539] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.498788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.498788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.499048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.499198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.507821] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: IN_PROGRESS for 2s [ 783.604473] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 975cda98-7ce9-4069-92ef-1a3ad541cec2 [ 783.604779] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.604922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.604992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.605248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.605344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.605457] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:975cda98-7ce9-4069-92ef-1a3ad541cec2 already deleted. [ 783.605559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-975cda98-7ce9-4069-92ef-1a3ad541cec2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.910654] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.910855] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.910939] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.911248] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.911406] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.911564] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 6a88cc7e-f210-4884-826d-46dad9672ce6 not found, creating... [ 783.911854] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.912104] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.912241] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.912577] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.912670] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.912886] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.913631] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.913856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.914130] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.914288] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.914448] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 6a88cc7e-f210-4884-826d-46dad9672ce6 is going to be created. [ 783.937157] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.937316] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.937520] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.937857] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.938213] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.938512] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.949159] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6538532-12c3-446d-9b87-832be9d329cf req-09a351df-b1dc-4ffc-934b-6ea241e018ec service nova] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 784.949470] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6538532-12c3-446d-9b87-832be9d329cf req-09a351df-b1dc-4ffc-934b-6ea241e018ec service nova] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 784.949513] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6538532-12c3-446d-9b87-832be9d329cf req-09a351df-b1dc-4ffc-934b-6ea241e018ec service nova] Enqueued Resource ID: 6a88cc7e-f210-4884-826d-46dad9672ce6 with Priority: HIGHEST for action port [ 784.950179] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_rules [ 784.950417] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 784.950575] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a88cc7e-f210-4884-826d-46dad9672ce6 with Priority: HIGHEST for action port [ 784.950914] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.951057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.951129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.951367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.951456] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.952642] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.952757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.952998] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a88cc7e-f210-4884-826d-46dad9672ce6 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.953112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.953199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.953386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.953465] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a88cc7e-f210-4884-826d-46dad9672ce6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.109757] env[64436]: INFO networking_nsxv3.common.synchronization [None req-725aa27a-d5f2-4659-a720-f210816d603d tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 785.114183] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 785.115511] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.115667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.115739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.116792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.116792] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.222565] env[64436]: INFO networking_nsxv3.common.synchronization [None req-25a84096-11d8-4b01-af24-5921a664d59c None None] Enqueued Resource ID: dac15b8e-9d41-4600-8dc5-28c96a0581e8 with Priority: HIGHEST for action port [ 785.222840] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac15b8e-9d41-4600-8dc5-28c96a0581e8 with Priority: HIGHEST for action port [ 785.223443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-dac15b8e-9d41-4600-8dc5-28c96a0581e8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.223570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dac15b8e-9d41-4600-8dc5-28c96a0581e8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.223638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dac15b8e-9d41-4600-8dc5-28c96a0581e8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.223892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dac15b8e-9d41-4600-8dc5-28c96a0581e8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.223965] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac15b8e-9d41-4600-8dc5-28c96a0581e8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.455573] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a88cc7e-f210-4884-826d-46dad9672ce6 with status ACTIVE [ 785.456033] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.456359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.458649] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.458649] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.458649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.458649] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a88cc7e-f210-4884-826d-46dad9672ce6 is going to be updated. [ 785.460930] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.461598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.471938] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 in Status: SUCCESS [ 785.472500] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 deletion is rescheduled due to dependency. [ 785.472500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.481326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.481626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.481770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.482093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.482408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.484722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a88cc7e-f210-4884-826d-46dad9672ce6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.522045] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 785.522045] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc deletion is rescheduled due to dependency. [ 785.522045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.522045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.522045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.522045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.522045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.522045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.522045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.522045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.522045] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.648545] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.648545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.648545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.648545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.648545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.648545] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 already deleted. [ 785.648545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.660198] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ed1359af-890d-4cca-8f2a-afd2709c4f34 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 785.661626] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 785.661626] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.661871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.661871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.662192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.662331] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.728706] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dac15b8e-9d41-4600-8dc5-28c96a0581e8 [ 785.728813] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.728994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.729083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.729952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.729952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.729952] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dac15b8e-9d41-4600-8dc5-28c96a0581e8 already deleted. [ 785.729952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dac15b8e-9d41-4600-8dc5-28c96a0581e8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.008284] env[64436]: INFO networking_nsxv3.common.synchronization [None req-5ac2b9ad-5339-4a72-9e65-f177ccd8aed8 None None] Enqueued Resource ID: 941640a9-0c21-4c70-999c-609c2e5f74d0 with Priority: HIGHEST for action port [ 786.010535] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 941640a9-0c21-4c70-999c-609c2e5f74d0 with Priority: HIGHEST for action port [ 786.010535] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-941640a9-0c21-4c70-999c-609c2e5f74d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.010535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-941640a9-0c21-4c70-999c-609c2e5f74d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.010535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-941640a9-0c21-4c70-999c-609c2e5f74d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.010535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-941640a9-0c21-4c70-999c-609c2e5f74d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.010535] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('941640a9-0c21-4c70-999c-609c2e5f74d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.027807] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.181379] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.183552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.183552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.183552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.183552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.183552] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 already deleted. [ 786.183552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.515121] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 941640a9-0c21-4c70-999c-609c2e5f74d0 [ 786.515271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.515442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.515537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.515808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.515923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.516057] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:941640a9-0c21-4c70-999c-609c2e5f74d0 already deleted. [ 786.516191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-941640a9-0c21-4c70-999c-609c2e5f74d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.528979] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.031592] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.032119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.032119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.032119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.032273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.032651] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be updated. [ 787.059884] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.059884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.060187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.060381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.060381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.068622] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: IN_PROGRESS for 2s [ 787.800842] env[64436]: INFO networking_nsxv3.common.synchronization [req-4f4d0055-b35f-498a-9631-b69c94ca1fee req-c6f36b24-9c1f-4990-acc1-da215b3604f9 tempest-ImagesOneServerNegativeTestJSON-1226860107 tempest-ImagesOneServerNegativeTestJSON-1226860107-project-member] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 787.801515] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGHEST for action security_group_members [ 787.802217] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.802351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.802475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.802708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.802871] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.803010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.803228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.803228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.803316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.803361] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.055622] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f696c797-f554-4c61-8cd9-507a47c00022 None None] Enqueued Resource ID: ee0c73ac-c30b-48e1-957b-cfe90c674074 with Priority: HIGHEST for action port [ 788.056021] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0c73ac-c30b-48e1-957b-cfe90c674074 with Priority: HIGHEST for action port [ 788.057452] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee0c73ac-c30b-48e1-957b-cfe90c674074 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.057452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee0c73ac-c30b-48e1-957b-cfe90c674074" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.057452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee0c73ac-c30b-48e1-957b-cfe90c674074" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.057452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee0c73ac-c30b-48e1-957b-cfe90c674074" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.057452] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee0c73ac-c30b-48e1-957b-cfe90c674074',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.305525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.305698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.305784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.306365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.306365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.306365] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.306836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.306836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.306836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.306836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.306944] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be updated. [ 788.332432] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.332590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.332590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.333623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.333623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.341386] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: IN_PROGRESS for 2s [ 788.559829] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee0c73ac-c30b-48e1-957b-cfe90c674074 [ 788.560860] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.560860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.560860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.560860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.560860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.561158] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee0c73ac-c30b-48e1-957b-cfe90c674074 already deleted. [ 788.561158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee0c73ac-c30b-48e1-957b-cfe90c674074" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.077294] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 789.077592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.077698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.077953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.078165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.078282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.078358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.078505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.078588] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.078674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.078764] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.580931] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.083392] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2392c42b-4327-4a1f-85ce-846d4a8981fc: rpc.has_security_group_logging(os_id): False [ 790.101555] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.101746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.101782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.102042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.102446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.102757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.102887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.102961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.103244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.103376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.103477] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be updated. [ 790.159490] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.159684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.159684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.159845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.160022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.171111] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: IN_PROGRESS for 2s [ 790.352261] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 in Status: SUCCESS [ 790.352477] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 deletion is rescheduled due to dependency. [ 790.352616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.182786] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 792.183122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.056951] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 793.058201] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 795.081148] env[64436]: INFO networking_nsxv3.common.synchronization [req-bc4a52ce-7f09-4852-a200-3ab963d01686 req-f2075b95-6b52-40ea-abef-a831783e474d tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 795.082785] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 795.083546] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.083691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.083763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.083998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.084173] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.084278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.084340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.084491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.084573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.084662] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.589164] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.004577] env[64436]: INFO networking_nsxv3.common.synchronization [req-f588b9f3-b9d5-4e78-b7d2-5fcfd9b8f94a req-88abca95-4c42-4c6a-b8d5-d112f2c5dcb2 tempest-VolumesAdminNegativeTest-1750673227 tempest-VolumesAdminNegativeTest-1750673227-project-member] Enqueued Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_members [ 796.004863] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_members [ 796.005186] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.005856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.005856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.005856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.005856] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.006042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.006042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.006178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.006262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.006363] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.094250] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.508083] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.508251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.508320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.508527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.508614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.508807] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.508920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.508986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.509148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.509220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.509300] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 already deleted. [ 796.509378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.596753] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.596753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.596753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.596916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.597140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.597140] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 796.629246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.629996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.629996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.629996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.629996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.641484] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 796.954848] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.955132] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.955286] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.955612] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.955856] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.956321] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.956755] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.956755] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.956755] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.956965] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.957097] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.957210] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.957322] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.957435] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.957543] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.957781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.975808] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.976020] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.976187] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.977114] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-648" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.977188] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b0a5f375-1a5b-407b-8343-e500ef024d2a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.977344] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.977471] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.977792] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.977997] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a5f375-1a5b-407b-8343-e500ef024d2a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.484266] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.484566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.484662] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.484954] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.485132] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.485291] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b0a5f375-1a5b-407b-8343-e500ef024d2a not found, creating... [ 797.485550] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.485713] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.485869] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.486298] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.486437] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.486740] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.486906] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.487475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.487777] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.488018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.488227] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b0a5f375-1a5b-407b-8343-e500ef024d2a is going to be created. [ 797.507332] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.507930] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.507930] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.508577] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.508577] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.508726] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.314173] env[64436]: INFO networking_nsxv3.common.synchronization [req-f588b9f3-b9d5-4e78-b7d2-5fcfd9b8f94a req-e6221938-6004-4fa7-a803-193f373936a3 service nova] Enqueued Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_rules [ 798.314173] env[64436]: INFO networking_nsxv3.common.synchronization [req-f588b9f3-b9d5-4e78-b7d2-5fcfd9b8f94a req-e6221938-6004-4fa7-a803-193f373936a3 service nova] Enqueued Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_members [ 798.314173] env[64436]: INFO networking_nsxv3.common.synchronization [req-f588b9f3-b9d5-4e78-b7d2-5fcfd9b8f94a req-e6221938-6004-4fa7-a803-193f373936a3 service nova] Enqueued Resource ID: b0a5f375-1a5b-407b-8343-e500ef024d2a with Priority: HIGHEST for action port [ 798.314173] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_rules [ 798.314173] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_members [ 798.314173] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a5f375-1a5b-407b-8343-e500ef024d2a with Priority: HIGHEST for action port [ 798.314668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.314977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.315137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.315542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.315692] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.317214] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.317465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.317679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.317946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.318209] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.318401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.318529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.318752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.318909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.323386] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.323386] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0a5f375-1a5b-407b-8343-e500ef024d2a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.323386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.323386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.323386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.323386] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a5f375-1a5b-407b-8343-e500ef024d2a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.651540] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 798.651846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.826790] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.826790] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0a5f375-1a5b-407b-8343-e500ef024d2a with status ACTIVE [ 798.826790] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.826790] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.826790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.826790] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.827259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.827259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.827259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.827259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.827259] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0a5f375-1a5b-407b-8343-e500ef024d2a is going to be updated. [ 798.832865] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.857156] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.857254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.857900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.857900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.857900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.857900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0a5f375-1a5b-407b-8343-e500ef024d2a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.082686] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.082899] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.083098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.083364] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.083660] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.083836] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.083981] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.084380] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.084584] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.084849] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.085030] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.085182] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.085335] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.085508] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.085669] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.085835] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.118347] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.118530] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.118688] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.118869] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.119249] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b094d056-8fa9-4280-a019-ac6dc777b089 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.119427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.119545] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.119806] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.119958] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b094d056-8fa9-4280-a019-ac6dc777b089',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.336035] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.623188] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.623437] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.623570] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.623869] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.624048] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.624346] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.624507] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.624631] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.624852] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.624993] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.625293] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.625455] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.625580] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.625792] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.626086] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.626263] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b094d056-8fa9-4280-a019-ac6dc777b089 is going to be updated. [ 799.647527] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.647817] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.647896] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.648265] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.648477] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.648761] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.838794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.839105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.839211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.839438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.839545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.839658] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 is going to be created. [ 799.867373] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.867547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.867636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.868088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.868267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.878161] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 in Status: UNINITIALIZED for 2s [ 800.357702] env[64436]: INFO networking_nsxv3.common.synchronization [req-701b4733-d14a-45ee-ab1b-e905c1b9f8ca req-0156eed3-68db-491a-9e30-90dad9975523 service nova] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 800.358015] env[64436]: INFO networking_nsxv3.common.synchronization [req-701b4733-d14a-45ee-ab1b-e905c1b9f8ca req-0156eed3-68db-491a-9e30-90dad9975523 service nova] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 800.358102] env[64436]: INFO networking_nsxv3.common.synchronization [req-701b4733-d14a-45ee-ab1b-e905c1b9f8ca req-0156eed3-68db-491a-9e30-90dad9975523 service nova] Enqueued Resource ID: b094d056-8fa9-4280-a019-ac6dc777b089 with Priority: HIGHEST for action port [ 800.358363] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_rules [ 800.358516] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 800.358606] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094d056-8fa9-4280-a019-ac6dc777b089 with Priority: HIGHEST for action port [ 800.359318] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.359492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.359584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.359820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.359930] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.361668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.361792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.361880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.362088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.362469] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.362469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.362469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.362633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.362669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.362876] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.366692] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b094d056-8fa9-4280-a019-ac6dc777b089 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.368214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.368214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.368214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.368214] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b094d056-8fa9-4280-a019-ac6dc777b089',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.587853] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ce322892-394c-480a-b1a4-e3a5acfc8e77 tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_rules [ 800.587853] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_rules [ 800.588277] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b20bfe1-a213-442b-9906-0002d7f3fe25 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.588326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.588682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.589266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.589452] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.681413] env[64436]: INFO networking_nsxv3.common.synchronization [None req-3f33c9d0-ea8d-4d2c-8f62-c486a83be7dc tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_rules [ 800.682390] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_rules [ 800.682551] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b20bfe1-a213-442b-9906-0002d7f3fe25 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.682654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.870707] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.872195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.872458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.873264] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b094d056-8fa9-4280-a019-ac6dc777b089 with status ACTIVE [ 800.873264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.873264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.873264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.873556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.873729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.873972] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.874183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.874320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.874547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.874705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.874967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.875183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.877206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.877206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.877206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.877206] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b094d056-8fa9-4280-a019-ac6dc777b089 is going to be updated. [ 800.910163] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.910163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.910163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.910163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.910163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.910163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b094d056-8fa9-4280-a019-ac6dc777b089" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.108719] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.108719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.110779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.110779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.110779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.110779] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 already deleted. [ 801.110779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.110779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.110779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.110779] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.377441] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.633738] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.634155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.634270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.634588] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.634744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.634997] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 already deleted. [ 801.635150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.880892] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.881289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.881289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.881445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.881554] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.881673] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d is going to be updated. [ 801.891019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 in Status: SUCCESS [ 801.891282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.891468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.891746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.891988] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.892128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.892233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.892342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.892438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.892528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.892619] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.908253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.908408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.908485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.908674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.908814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.917657] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: IN_PROGRESS for 2s [ 802.396704] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.396704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.396704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.396704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.397031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.397031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.397031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.397235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.397275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.397461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.397672] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.397883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.397883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.398029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.398148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.398275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.398341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.398485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.398561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.398642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.398734] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.901404] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f24df5e6-b8ac-4b7a-898c-90fa972dda35: rpc.has_security_group_logging(os_id): False [ 802.922713] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.922918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.922994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.923242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.923366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.923563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.923690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.923718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.923865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.923943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.924151] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.924239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.924294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.924463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.924490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.924675] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.924769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.924829] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.924961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.925049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.925138] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 is going to be created. [ 802.987728] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.987971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.988024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.988259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.988449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.007527] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 in Status: IN_PROGRESS for 2s [ 803.927534] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: SUCCESS [ 803.927907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.927907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.928197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.928400] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.928520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.928585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.928745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.928830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.928918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.929024] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.432854] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.566877] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-0de62a53-50ef-4db8-9d5e-658f362cadb4 tempest-ListServersNegativeTestJSON-435753161 tempest-ListServersNegativeTestJSON-435753161-project-member] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 804.567139] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 804.567443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.567565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.569605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.569906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.570108] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.570216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.570288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.570464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.570553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.570658] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.906706] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.906919] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.907080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.907409] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.907669] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.908391] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.908391] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.908391] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.908550] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.908718] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.908863] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.909021] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.909168] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.909313] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.909448] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.909610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.927421] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.927755] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.928073] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.928392] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.928917] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.929234] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.929395] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.929703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.929851] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b20b1e9d-9ae2-4de7-8052-2d9efb2836b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.934295] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfb4c1c6-2021-458b-840f-cd83ee502c3d: rpc.has_security_group_logging(os_id): False [ 804.951644] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.951785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.951902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.952044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.974277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.974607] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.974752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.974844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.975082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.975195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.975306] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d is going to be updated. [ 805.019030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 in Status: SUCCESS [ 805.019162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.032044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.032233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.032314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.032598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.032787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.044019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: IN_PROGRESS for 2s [ 805.072897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.073105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.073180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.073416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.073532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.073726] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.073825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.073891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.074084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.074169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.074250] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 already deleted. [ 805.074329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.432077] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.432242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.432370] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.432702] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.432903] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.433198] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 not found, creating... [ 805.433590] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.433818] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.433953] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.434243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.434426] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.434757] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.434934] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.435149] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.435410] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.435634] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.435821] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 is going to be created. [ 805.457571] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.457737] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.457829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.458172] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.458440] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.458726] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.240138] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-18c425b1-bec7-4165-900f-2556b6cf8da5 service nova] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_rules [ 806.240446] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-18c425b1-bec7-4165-900f-2556b6cf8da5 service nova] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 806.240493] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-18c425b1-bec7-4165-900f-2556b6cf8da5 service nova] Enqueued Resource ID: b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 with Priority: HIGHEST for action port [ 806.240747] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_rules [ 806.240876] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 806.240973] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 with Priority: HIGHEST for action port [ 806.241571] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.241709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.241773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.243365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.243499] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.246408] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.246536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.246598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.246786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.246936] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.247045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.247143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.247305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.247392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.247508] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.252546] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.252752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.252847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.253085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.253173] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b20b1e9d-9ae2-4de7-8052-2d9efb2836b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.753668] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.757189] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 with status ACTIVE [ 806.757189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.757189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.757189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.757189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.757189] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b20b1e9d-9ae2-4de7-8052-2d9efb2836b0 is going to be updated. [ 806.759444] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.759696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.779133] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.779133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.779133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.779133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.779133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.779133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b20b1e9d-9ae2-4de7-8052-2d9efb2836b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.874959] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-50cc3382-5f92-4a6b-b42b-6887ba46ed9d tempest-ListServersNegativeTestJSON-435753161 tempest-ListServersNegativeTestJSON-435753161-project-member] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 806.875551] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 806.875866] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.876044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.058866] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: SUCCESS [ 807.058866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.175343] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.175550] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.175681] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.176084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.176889] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.176889] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.176889] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.177350] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.177350] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.177440] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.177566] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.177651] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.177765] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.178169] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.178169] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.178169] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.204236] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.204493] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.204650] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.204833] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.205259] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-aaded852-18dc-4427-97cf-be4d114aa9e7 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.205443] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.205570] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.205962] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.206125] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaded852-18dc-4427-97cf-be4d114aa9e7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.259632] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.709670] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.709670] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.709670] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.709923] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.709923] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.710047] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port aaded852-18dc-4427-97cf-be4d114aa9e7 not found, creating... [ 807.710303] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.710532] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.710726] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.710921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.711080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.711409] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.711576] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.711662] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.711853] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.711987] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.712147] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: aaded852-18dc-4427-97cf-be4d114aa9e7 is going to be created. [ 807.734031] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.734031] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.734031] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.734385] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.734558] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.734859] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.762622] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.762790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.762852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.763074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.763175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.763273] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be created. [ 807.783114] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.783244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.783317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.783507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.783668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.791964] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: UNINITIALIZED for 2s [ 808.447979] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-d6319c4d-453b-443a-875c-008154d0057f service nova] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_rules [ 808.448262] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-d6319c4d-453b-443a-875c-008154d0057f service nova] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 808.448372] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-d6319c4d-453b-443a-875c-008154d0057f service nova] Enqueued Resource ID: aaded852-18dc-4427-97cf-be4d114aa9e7 with Priority: HIGHEST for action port [ 808.448618] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_rules [ 808.448743] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 808.448846] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaded852-18dc-4427-97cf-be4d114aa9e7 with Priority: HIGHEST for action port [ 808.449554] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.449663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.449897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.449981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.450215] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaded852-18dc-4427-97cf-be4d114aa9e7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.451180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.452193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.452193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.452193] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaded852-18dc-4427-97cf-be4d114aa9e7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.953408] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aaded852-18dc-4427-97cf-be4d114aa9e7 with status ACTIVE [ 808.953638] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.953783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.953861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.954108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.954214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.954405] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.954528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.954586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.954714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.954787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.954980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.955083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.955135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.955271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.955343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.955533] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aaded852-18dc-4427-97cf-be4d114aa9e7 is going to be updated. [ 808.977228] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.977431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.977431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.977644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.977778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.977943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaded852-18dc-4427-97cf-be4d114aa9e7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.803666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 809.804129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.804388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.804687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.804901] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.805029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.805094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.805265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.805347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.805446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.805546] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.806493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.806718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.806913] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.807046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.807119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.807415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.807471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.807590] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.054881] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-5627237c-3e2b-44cb-9c89-a76505aaaf33 tempest-ListServersNegativeTestJSON-435753161 tempest-ListServersNegativeTestJSON-435753161-project-member] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 810.055559] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 810.055889] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.056039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.314778] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.314778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.314778] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.420862] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.420862] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.421032] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.421539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.421901] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.422204] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.422429] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.422843] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.423136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.423524] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.423721] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.423949] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.424196] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.424437] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.424692] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.425087] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.445823] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.445823] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 810.446068] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.446279] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-142" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.446617] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.446800] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.446927] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.447304] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.447454] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c87a9f2-43ec-4bc1-b4b5-80f2dc460127',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.817673] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.950572] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.952439] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.952439] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.952439] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.952439] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.952439] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 not found, creating... [ 810.952773] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.953128] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.953356] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.953764] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.954030] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.954582] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.954890] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.955491] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.955562] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.956265] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.956265] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 is going to be created. [ 810.982467] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.982736] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.982931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.983316] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.983675] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.984035] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.321346] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.321898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.321898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.322052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.322198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.322347] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 811.353426] env[64436]: INFO networking_nsxv3.common.synchronization [req-b2b7551a-2bf1-45b0-8d06-c08b1d4939e6 req-dfe6cf4b-23e2-4a07-9355-fb0baacd404d tempest-ListImageFiltersTestJSON-829589829 tempest-ListImageFiltersTestJSON-829589829-project-member] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 811.353426] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 811.353507] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.353587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.353750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.353864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.354027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.354198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.354198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.355398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.355398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.355398] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.359406] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.359406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.359406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.359664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.359664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.370788] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 811.715738] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-5ab8b7d1-dfb9-4d23-b879-1c641a87f72d service nova] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_rules [ 811.715951] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-5ab8b7d1-dfb9-4d23-b879-1c641a87f72d service nova] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 811.716121] env[64436]: INFO networking_nsxv3.common.synchronization [req-c323b004-fdf8-4290-8961-0bad18f6369a req-5ab8b7d1-dfb9-4d23-b879-1c641a87f72d service nova] Enqueued Resource ID: 9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 with Priority: HIGHEST for action port [ 811.716699] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_rules [ 811.716780] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 811.716910] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 with Priority: HIGHEST for action port [ 811.718697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.718799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.718956] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.719082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.719290] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.719375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.719479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.719646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.719726] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c87a9f2-43ec-4bc1-b4b5-80f2dc460127',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.857691] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.221913] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 with status ACTIVE [ 812.222307] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.222513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.222607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.222835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.222933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.223138] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.223246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.223311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.223470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.223547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.223734] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.223878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.223980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.224223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.224314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.224426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c87a9f2-43ec-4bc1-b4b5-80f2dc460127 is going to be updated. [ 812.245771] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.245986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.245986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.246182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.246331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.246566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c87a9f2-43ec-4bc1-b4b5-80f2dc460127" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.360386] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.862640] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.863062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.863062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.863306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.863432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.863555] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be updated. [ 812.890931] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.891113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.891190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.891484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.891673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.903875] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: IN_PROGRESS for 2s [ 813.072640] env[64436]: INFO networking_nsxv3.common.synchronization [None req-69244a97-9295-4315-8b01-a5fc21455150 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_rules [ 813.073622] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_rules [ 813.074217] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.074484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.074676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.075115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.075289] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.154735] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f5d935b3-4840-4450-9eda-9e51d0d448fa tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_rules [ 813.155023] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_rules [ 813.155478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.155715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.384032] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 813.384334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.384682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.385098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.385490] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.385711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.385848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.386652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.386844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.386917] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.595920] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.596103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.596146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.596371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.596460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.596568] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 439934dd-a8d0-443b-bef1-613de792a394 already deleted. [ 813.596657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.596827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.596994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.597103] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.889765] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.119684] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.119849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.119976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.120234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.120369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.120489] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 439934dd-a8d0-443b-bef1-613de792a394 already deleted. [ 814.120596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.316466] env[64436]: INFO networking_nsxv3.common.synchronization [req-5bac1e47-0544-4f0a-9c72-a558048e1d68 req-329820f6-7d87-455e-9e4f-f8ae1b7d08d6 tempest-VolumesAdminNegativeTest-1750673227 tempest-VolumesAdminNegativeTest-1750673227-project-member] Enqueued Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_members [ 814.317920] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGHEST for action security_group_members [ 814.318402] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.318594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.318686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.319459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.319459] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.319459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.319459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.319712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.319712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.319818] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.391851] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.822967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.824210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.824210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.824210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.824210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.824210] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.824210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.824597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.825925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.825925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.825925] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 is going to be updated. [ 814.855648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.855648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.855648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.855648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.855648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.866941] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 in Status: IN_PROGRESS for 2s [ 814.895586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.896024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.896024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.896270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.896371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.896477] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 814.914868] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: SUCCESS [ 814.914950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.015622] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.015622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.015622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.015622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.015622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.018287] env[64436]: INFO networking_nsxv3.common.synchronization [req-3d36e2fb-11f2-478d-9b01-425c41ab7c1e req-fc4daefb-b41d-40cc-afd3-c16a8085b619 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 815.019079] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 815.020347] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.021225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.021225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.021225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.021225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.021225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.021225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.021615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.021763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.021904] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.027301] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 815.390252] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.390252] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.390252] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.390252] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.390252] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.390252] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.390731] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.391374] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.391687] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.392067] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.392346] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.392594] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.392834] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.393281] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.393570] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.393952] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.417072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.417284] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.417437] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.417630] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.418075] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-e7652b5b-b246-4052-b588-7b031f8f7f26 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.418279] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.418399] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.418731] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.418877] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7652b5b-b246-4052-b588-7b031f8f7f26',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.526978] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.527174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.527211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.527473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.527563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.527790] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.527941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.528059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.528306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.528399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.528503] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 815.556134] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.556289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.556371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.556594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.556746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.567696] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 815.922418] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.922418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.922418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.922937] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.923068] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.923281] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port e7652b5b-b246-4052-b588-7b031f8f7f26 not found, creating... [ 815.923596] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.923776] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.924035] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.924348] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.924538] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.924984] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.925136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.925560] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.925560] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.925684] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.925841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: e7652b5b-b246-4052-b588-7b031f8f7f26 is going to be created. [ 815.948580] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.948807] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.949021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.949410] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.949878] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.950191] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.651026] env[64436]: INFO networking_nsxv3.common.synchronization [req-3d36e2fb-11f2-478d-9b01-425c41ab7c1e req-f1f980a7-8528-4639-ba76-8ab76e60b64f service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 816.651026] env[64436]: INFO networking_nsxv3.common.synchronization [req-3d36e2fb-11f2-478d-9b01-425c41ab7c1e req-f1f980a7-8528-4639-ba76-8ab76e60b64f service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 816.651026] env[64436]: INFO networking_nsxv3.common.synchronization [req-3d36e2fb-11f2-478d-9b01-425c41ab7c1e req-f1f980a7-8528-4639-ba76-8ab76e60b64f service nova] Enqueued Resource ID: e7652b5b-b246-4052-b588-7b031f8f7f26 with Priority: HIGHEST for action port [ 816.651026] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 816.651026] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 816.651026] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7652b5b-b246-4052-b588-7b031f8f7f26 with Priority: HIGHEST for action port [ 816.651026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.651026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.651026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.651723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.651829] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.652810] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.654413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.654799] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7652b5b-b246-4052-b588-7b031f8f7f26 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.656500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.656500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.656500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.656500] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7652b5b-b246-4052-b588-7b031f8f7f26',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.878821] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 in Status: SUCCESS [ 816.878821] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 deletion is rescheduled due to dependency. [ 816.878821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.037008] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 817.037008] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.037008] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.037539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.037539] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.037643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.037762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.037959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.038170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.038319] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.157357] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.157503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.160799] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7652b5b-b246-4052-b588-7b031f8f7f26 with status ACTIVE [ 817.161047] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.161190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.161255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.161472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.161560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.161764] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.161836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.161907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.162114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.162147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.162352] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.162479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.162536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.162672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.162760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.162798] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7652b5b-b246-4052-b588-7b031f8f7f26 is going to be updated. [ 817.182032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.182220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.182297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.182541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.182713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.182929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7652b5b-b246-4052-b588-7b031f8f7f26" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.541107] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.577348] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 817.577538] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 817.577870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.577980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.578178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.578382] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.578532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.578603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.578775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.579153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.579299] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.045790] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.081220] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.548462] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.548710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.548710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.548925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.548993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.549134] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 818.575772] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.575914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.575983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.576249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.576401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.585030] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.586904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 819.089054] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.089054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.089054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.089054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.089054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.089573] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 819.155864] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.156026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.156026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.156236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.156389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.165226] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 820.599172] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.599172] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.599172] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.599172] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.599172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.599963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.599963] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.600536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.601223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.601223] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.601223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.601634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.601924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.602148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.602398] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.105205] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c72e70d-81aa-4c66-a80b-9d5f04b046c1: rpc.has_security_group_logging(os_id): False [ 821.106619] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.130747] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.131910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.132044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.132242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.132347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.132558] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.132672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.132735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.132889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.132966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.133634] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.133634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.133634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.133634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.133634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.134053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.134053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.134053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.134053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.134268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.134268] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be created. [ 821.185295] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 821.185515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.185678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.186884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.186884] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.186884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.186884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.186884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.186884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.186884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.186884] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.205632] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.205632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.205632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.205632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.205632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.220610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 821.612402] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.652391] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 821.652391] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 821.690076] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.690076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.690076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.690076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.690409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.690409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.690409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.690547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.690547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.690640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.694022] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.694022] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.694022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.694022] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.114855] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.115062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.115297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.115403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.115501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.115738] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 822.144113] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.144312] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.144353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.144647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.144825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.153049] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 822.197561] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f75433d-92b0-49c0-b145-a45f748925ab: rpc.has_security_group_logging(os_id): False [ 822.216397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.216541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.217121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.217121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.217121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.217121] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.217310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.217310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.217555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.217686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.217896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.218009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.218082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.218340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.218431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.218695] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.218803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.218882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.219040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.219141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.219242] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 822.275726] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.275948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.276062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.280924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.280924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.293537] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 822.938708] env[64436]: INFO networking_nsxv3.common.synchronization [req-250fe7e5-9dfb-4e6d-8ee4-56bdf0e46522 req-f6024c1a-3ee0-4ff2-ba90-c9058df95b08 tempest-ListServersNegativeTestJSON-435753161 tempest-ListServersNegativeTestJSON-435753161-project-member] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 822.939291] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 822.939607] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.939989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.232356] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 823.232644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.232870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.233126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.233210] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.735963] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.736099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.162431] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 824.162712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.162944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.163193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.163381] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.163486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.163549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.163732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.163817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.163916] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.305241] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 824.305506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.666521] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.171887] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.674834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.675018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.675090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.675312] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.675410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.675513] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 825.702708] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.702708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.702708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.702708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.702904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.710423] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 827.725055] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 827.725307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.725450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.725660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.725854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.725964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.726063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.726253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.726339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.726423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.726509] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.940334] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 827.940455] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 828.116029] env[64436]: INFO networking_nsxv3.common.synchronization [req-944eac2a-4429-49fb-95b1-ebb974222ecf req-2aac9495-9222-4a8f-becb-59c39378c3d9 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 828.116029] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 828.116029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.116029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.116029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.116313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.116488] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.116613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.116680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.116836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.116925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.118854] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.232039] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.232039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.232039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.232039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.232369] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.232369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.232369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.232475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.232475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.232573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.232688] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.232778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.232838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.232977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.233135] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.234451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.234451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.234451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.234451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.234451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.234451] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.623701] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.623701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.623825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.624032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.624101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.624324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.624528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.624528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.624683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.624750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.626380] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 already deleted. [ 828.626380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.706233] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.706547] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-551" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.706708] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-551" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.707078] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-551" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.707426] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.707625] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.707753] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.708100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.708339] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.708566] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.708687] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.708804] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.708913] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.709034] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.709143] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.709292] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.728587] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.729204] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.729204] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.729204] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-551" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.729425] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-4a236d4f-2873-4efc-ae08-ca1d849adb13 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.729604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.729958] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.730075] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.730356] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a236d4f-2873-4efc-ae08-ca1d849adb13',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.736546] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c72e70d-81aa-4c66-a80b-9d5f04b046c1: rpc.has_security_group_logging(os_id): False [ 828.752926] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.753708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.753708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.754196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.754196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.755377] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.755873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.755873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.755873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.755873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.756538] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.756538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.756538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.756674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.756701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.756888] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.756984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.757067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.757226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.757280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.757370] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 828.814987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.815156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.815228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.815540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.815727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.827469] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 829.233481] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.233706] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.233832] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.235393] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.235393] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.235393] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 4a236d4f-2873-4efc-ae08-ca1d849adb13 not found, creating... [ 829.235393] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.235603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.235686] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.235926] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.236075] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.236424] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.236579] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.236901] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.236901] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.240134] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.240805] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 is going to be created. [ 829.260156] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.260156] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.260156] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.260156] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.260649] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.260649] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.051464] env[64436]: INFO networking_nsxv3.common.synchronization [req-944eac2a-4429-49fb-95b1-ebb974222ecf req-983dc0f9-9f12-49dd-9c01-ef80201630ba service nova] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 830.051759] env[64436]: INFO networking_nsxv3.common.synchronization [req-944eac2a-4429-49fb-95b1-ebb974222ecf req-983dc0f9-9f12-49dd-9c01-ef80201630ba service nova] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 830.055134] env[64436]: INFO networking_nsxv3.common.synchronization [req-944eac2a-4429-49fb-95b1-ebb974222ecf req-983dc0f9-9f12-49dd-9c01-ef80201630ba service nova] Enqueued Resource ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 with Priority: HIGHEST for action port [ 830.055134] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 830.055134] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 830.055134] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 with Priority: HIGHEST for action port [ 830.055134] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.055134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.055134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.055134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.055134] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.055405] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.055759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.055759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.055759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.055886] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.055929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.056309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.059432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.059432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.059432] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.059432] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a236d4f-2873-4efc-ae08-ca1d849adb13 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.059432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.059432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.059432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.059432] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a236d4f-2873-4efc-ae08-ca1d849adb13',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.434876] env[64436]: INFO networking_nsxv3.common.synchronization [req-99cb4350-9473-4548-93f6-e7af2754903f req-64306b22-a8d3-4518-b8fc-2fc7349a482e tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 830.435434] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 830.435959] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.436714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.436803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.437185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.437431] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.438095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.438278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.438663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.438663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.438764] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.560114] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.560344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.563718] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.564980] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a236d4f-2873-4efc-ae08-ca1d849adb13 with status ACTIVE [ 830.567919] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.567919] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.567919] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.567919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.567919] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 is going to be updated. [ 830.586235] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.586411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.586455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.586666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.586806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.586977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.844152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 830.844152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.844152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.844152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.844152] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.943267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.943267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.943267] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 already deleted. [ 830.943267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.069390] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.352841] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.352841] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.352841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.352841] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.404136] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.404136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.404136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.404136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.404136] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.404136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.404609] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.404957] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.405249] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.405571] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.405790] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.406023] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.407381] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.407632] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.407839] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.408084] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.428020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.428020] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.428020] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.428020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.428020] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-fac3ca19-4214-4b50-ab63-07b289ad9bea taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.428020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.428020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.428020] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.428020] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fac3ca19-4214-4b50-ab63-07b289ad9bea',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.576107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.576107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.576107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.576107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.576107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.576107] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be created. [ 831.597694] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.597694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.597694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.597694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.597694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.605821] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: UNINITIALIZED for 2s [ 831.855380] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.855655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.855773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.856220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.856399] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.856518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.856592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.856705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.856790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.856934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.857262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.857262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.857262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.859253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.859253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.859253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.859253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.859253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.859253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.859253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.859253] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.933918] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.933918] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.933918] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.934403] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.934403] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.934554] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port fac3ca19-4214-4b50-ab63-07b289ad9bea not found, creating... [ 831.934919] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.934983] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.935160] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.935642] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.935826] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.936149] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.936316] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.936573] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.936663] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.936880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.936952] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: fac3ca19-4214-4b50-ab63-07b289ad9bea is going to be created. [ 831.954941] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.955279] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.955349] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.955599] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.955840] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.956103] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.055964] env[64436]: INFO networking_nsxv3.common.synchronization [None req-1c484019-f019-47d2-92b9-1533d58d28c6 None None] Enqueued Resource ID: da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e with Priority: HIGHEST for action port [ 832.056035] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e with Priority: HIGHEST for action port [ 832.056745] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.056913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.057019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.057293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.057422] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.366221] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c72e70d-81aa-4c66-a80b-9d5f04b046c1: rpc.has_security_group_logging(os_id): False [ 832.383658] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.384563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.384563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.384563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.384563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.384563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.384563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.384563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.384813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.384813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.384947] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.385049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.385157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.385255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.385331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.385510] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.385603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.385758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.385819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.385895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.385978] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 832.443636] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.444891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.444891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.444891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.444891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.457922] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 832.559729] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e [ 832.560152] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.560358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.560468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.560813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.560973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.561144] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e already deleted. [ 832.561287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da3fc9f0-7636-4f5f-9daf-d4cb69f9b26e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.969019] env[64436]: INFO networking_nsxv3.common.synchronization [None req-bc731b36-a83f-4146-a760-58c24a04fbc6 None None] Enqueued Resource ID: 3d163ac5-489d-4269-9981-9f11c38d5301 with Priority: HIGHEST for action port [ 832.969872] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d163ac5-489d-4269-9981-9f11c38d5301 with Priority: HIGHEST for action port [ 832.969932] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d163ac5-489d-4269-9981-9f11c38d5301 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.970082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d163ac5-489d-4269-9981-9f11c38d5301" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.971092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d163ac5-489d-4269-9981-9f11c38d5301" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.971092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d163ac5-489d-4269-9981-9f11c38d5301" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.971092] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d163ac5-489d-4269-9981-9f11c38d5301',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.403932] env[64436]: INFO networking_nsxv3.common.synchronization [req-99cb4350-9473-4548-93f6-e7af2754903f req-9d41db39-d2f8-49f2-ae85-575d1bf3b0b3 service nova] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_rules [ 833.403932] env[64436]: INFO networking_nsxv3.common.synchronization [req-99cb4350-9473-4548-93f6-e7af2754903f req-9d41db39-d2f8-49f2-ae85-575d1bf3b0b3 service nova] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 833.403932] env[64436]: INFO networking_nsxv3.common.synchronization [req-99cb4350-9473-4548-93f6-e7af2754903f req-9d41db39-d2f8-49f2-ae85-575d1bf3b0b3 service nova] Enqueued Resource ID: fac3ca19-4214-4b50-ab63-07b289ad9bea with Priority: HIGHEST for action port [ 833.403932] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_rules [ 833.404413] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 833.404567] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fac3ca19-4214-4b50-ab63-07b289ad9bea with Priority: HIGHEST for action port [ 833.404931] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.405092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.405163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.405428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.405514] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.406740] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.406840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.406907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.407153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.407400] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.407783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.407901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.408123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.408297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.408470] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.409515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-fac3ca19-4214-4b50-ab63-07b289ad9bea taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.410939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.410939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.410939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.410939] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fac3ca19-4214-4b50-ab63-07b289ad9bea',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.473883] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d163ac5-489d-4269-9981-9f11c38d5301 [ 833.474359] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.474430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.474463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.474653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.474744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.474839] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d163ac5-489d-4269-9981-9f11c38d5301 already deleted. [ 833.475028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d163ac5-489d-4269-9981-9f11c38d5301" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.617546] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: SUCCESS [ 833.617751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.617917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.618139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.618341] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.618854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.618854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.618854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.618854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.618854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.619050] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.912188] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.915522] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.915522] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fac3ca19-4214-4b50-ab63-07b289ad9bea with status ACTIVE [ 833.915522] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.915522] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.915522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.915522] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.916039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.916039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.916039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.916039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.916039] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fac3ca19-4214-4b50-ab63-07b289ad9bea is going to be updated. [ 833.937330] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.942621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.942621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.942621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.942621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.942621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fac3ca19-4214-4b50-ab63-07b289ad9bea" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.003024] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ca6ab9-5a85-4018-b682-1f215099642e req-c8be730c-658a-4304-8069-98ecd9a1d618 tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 834.003453] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 834.003762] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.004088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.007800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.007882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.008078] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.008211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.008262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.008484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.008573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.009020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.121669] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.418143] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.473256] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 834.473256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.514691] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.626227] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ec0ad55-b4c7-4db0-9d96-64678434dae2: rpc.has_security_group_logging(os_id): False [ 834.639772] env[64436]: INFO networking_nsxv3.common.synchronization [None req-14cce983-a7db-4526-8b11-584af37d00f8 None None] Enqueued Resource ID: f98c39aa-3952-478e-b45b-dfb22dff8529 with Priority: HIGHEST for action port [ 834.644834] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f98c39aa-3952-478e-b45b-dfb22dff8529 with Priority: HIGHEST for action port [ 834.644834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-f98c39aa-3952-478e-b45b-dfb22dff8529 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f98c39aa-3952-478e-b45b-dfb22dff8529" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f98c39aa-3952-478e-b45b-dfb22dff8529" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f98c39aa-3952-478e-b45b-dfb22dff8529" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.644834] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f98c39aa-3952-478e-b45b-dfb22dff8529',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.644834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.644834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.644834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.646494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.646729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.648113] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be created. [ 834.704800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.707049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.707049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.707049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.707049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.714884] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: IN_PROGRESS for 2s [ 834.922039] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.922039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.922039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.922039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.922039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.922039] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be created. [ 834.954443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.954646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.954712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.955017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.955230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.969904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: UNINITIALIZED for 2s [ 835.017306] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.152239] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f98c39aa-3952-478e-b45b-dfb22dff8529 [ 835.152239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.152239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.152239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.152239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.152239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.152239] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f98c39aa-3952-478e-b45b-dfb22dff8529 already deleted. [ 835.152239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f98c39aa-3952-478e-b45b-dfb22dff8529" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.192432] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.192614] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.192829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.193044] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.193938] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.193938] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.193938] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.193938] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.194148] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.194399] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.194522] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.194643] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.194759] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.194875] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.194989] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.195425] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.213017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.213372] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.213372] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.213564] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.214056] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-329d483a-71d0-494c-9d9b-402e6d7e4ea5 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.214200] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.214200] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.214560] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.214707] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('329d483a-71d0-494c-9d9b-402e6d7e4ea5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.521586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.521863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.522075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.522288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.522356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.522541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 835.551196] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.551428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.551428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.551652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.551764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.561350] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 835.711854] env[64436]: INFO networking_nsxv3.common.synchronization [None req-7ce47e6a-d3c3-4508-abbe-c38459fcf2fa tempest-ServersTestJSON-230956575 tempest-ServersTestJSON-230956575-project-member] Enqueued Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_rules [ 835.711854] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_rules [ 835.711854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.711854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.712062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.712500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.712596] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.716946] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.717179] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.717415] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.717735] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.717963] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.718144] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 329d483a-71d0-494c-9d9b-402e6d7e4ea5 not found, creating... [ 835.718573] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.718917] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.718917] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.719181] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.719373] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.719657] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.719934] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.720406] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.720406] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.721383] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.721383] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 329d483a-71d0-494c-9d9b-402e6d7e4ea5 is going to be created. [ 835.743184] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.743493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.743830] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.744132] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.744413] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.744780] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.862120] env[64436]: INFO networking_nsxv3.common.synchronization [None req-3ae0e52b-626a-481f-9387-03324afc6559 tempest-ServersTestJSON-230956575 tempest-ServersTestJSON-230956575-project-member] Enqueued Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_rules [ 835.862674] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_rules [ 835.863967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.864464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.971209] env[64436]: INFO networking_nsxv3.common.synchronization [None req-08794b3b-d4a8-4c1a-8097-fc90b11fc179 None None] Enqueued Resource ID: 84927a59-5aed-4409-8bc8-259251320d9d with Priority: HIGHEST for action port [ 835.973019] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84927a59-5aed-4409-8bc8-259251320d9d with Priority: HIGHEST for action port [ 835.973019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-84927a59-5aed-4409-8bc8-259251320d9d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.973019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84927a59-5aed-4409-8bc8-259251320d9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.973019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84927a59-5aed-4409-8bc8-259251320d9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.973469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84927a59-5aed-4409-8bc8-259251320d9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.974557] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84927a59-5aed-4409-8bc8-259251320d9d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.092968] env[64436]: INFO networking_nsxv3.common.synchronization [req-6f0fc3d9-229d-495f-b04d-5b4c3a96973e req-d4602a13-48a4-4dd8-9599-3ffbc06d1910 tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 836.092968] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 836.092968] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.092968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.238715] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.238876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.238915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.240426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.240426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.240489] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 already deleted. [ 836.240531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.240756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.240854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.240936] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.476474] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84927a59-5aed-4409-8bc8-259251320d9d [ 836.476609] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.476815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.476815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.477113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.477221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.477334] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84927a59-5aed-4409-8bc8-259251320d9d already deleted. [ 836.477407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84927a59-5aed-4409-8bc8-259251320d9d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.571732] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.572108] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.572209] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.572513] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.572854] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.573260] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.573450] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.573666] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.573921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.574212] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.574390] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.574557] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.574723] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.578030] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.578030] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.578030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.593321] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.593534] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.593679] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.593934] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.594258] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-244613f0-50a4-49be-8fcd-cda9fbfc74e0 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.594779] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.594779] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.595131] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.595218] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244613f0-50a4-49be-8fcd-cda9fbfc74e0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.621974] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ca6ab9-5a85-4018-b682-1f215099642e req-5c8a6549-87e8-4fb0-bfa5-bf8054b4cc01 service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 836.622193] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ca6ab9-5a85-4018-b682-1f215099642e req-5c8a6549-87e8-4fb0-bfa5-bf8054b4cc01 service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 836.622366] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ca6ab9-5a85-4018-b682-1f215099642e req-5c8a6549-87e8-4fb0-bfa5-bf8054b4cc01 service nova] Enqueued Resource ID: 329d483a-71d0-494c-9d9b-402e6d7e4ea5 with Priority: HIGHEST for action port [ 836.622883] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 836.622968] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 836.630248] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 329d483a-71d0-494c-9d9b-402e6d7e4ea5 with Priority: HIGHEST for action port [ 836.630248] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.630248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.630248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.630248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.630248] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.631483] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.631615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.634237] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-329d483a-71d0-494c-9d9b-402e6d7e4ea5 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.635450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.635562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.636214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.636214] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('329d483a-71d0-494c-9d9b-402e6d7e4ea5',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.727285] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: SUCCESS [ 836.727520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.760954] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.761150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.761222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.761433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.761525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.761614] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 already deleted. [ 836.761709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.978538] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 836.978800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.978936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.979569] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.979569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.979569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.979808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.979808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.979900] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.980770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.981628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.981628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.981628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.981628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.981628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.981628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.981993] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.098399] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.099908] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.100073] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.100420] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.100532] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.100789] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 244613f0-50a4-49be-8fcd-cda9fbfc74e0 not found, creating... [ 837.101097] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.101729] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.101729] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.101729] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.102685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.102685] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.102685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.102685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.102685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.102685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.102863] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 244613f0-50a4-49be-8fcd-cda9fbfc74e0 is going to be created. [ 837.121515] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.122710] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.122710] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.122710] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.122710] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.122930] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.137951] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.138196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.138933] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 329d483a-71d0-494c-9d9b-402e6d7e4ea5 with status ACTIVE [ 837.138933] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.138933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.138933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.139259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.139259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.139259] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.139435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.139435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.139519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.139587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.139787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.139883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.139932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.140094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.140165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.140247] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 329d483a-71d0-494c-9d9b-402e6d7e4ea5 is going to be updated. [ 837.159900] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.160056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.160123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.160323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.160465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.160631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-329d483a-71d0-494c-9d9b-402e6d7e4ea5" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.484253] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.486727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.487606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.573768] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 837.573768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.574185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.574436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.574436] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.574436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.574436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.574436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.575068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.575068] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.990207] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.077588] env[64436]: INFO networking_nsxv3.common.synchronization [req-6f0fc3d9-229d-495f-b04d-5b4c3a96973e req-20c7b28f-0e96-43b2-ad00-e731b8ce8084 service nova] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_rules [ 838.077588] env[64436]: INFO networking_nsxv3.common.synchronization [req-6f0fc3d9-229d-495f-b04d-5b4c3a96973e req-20c7b28f-0e96-43b2-ad00-e731b8ce8084 service nova] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 838.077588] env[64436]: INFO networking_nsxv3.common.synchronization [req-6f0fc3d9-229d-495f-b04d-5b4c3a96973e req-20c7b28f-0e96-43b2-ad00-e731b8ce8084 service nova] Enqueued Resource ID: 244613f0-50a4-49be-8fcd-cda9fbfc74e0 with Priority: HIGHEST for action port [ 838.077588] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_rules [ 838.077863] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 838.077863] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 244613f0-50a4-49be-8fcd-cda9fbfc74e0 with Priority: HIGHEST for action port [ 838.081307] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.081307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.081307] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.081307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.082223] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-244613f0-50a4-49be-8fcd-cda9fbfc74e0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.082223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.082223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.082223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.082223] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244613f0-50a4-49be-8fcd-cda9fbfc74e0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.082859] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.493530] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.494352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.494352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.494352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.494538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.494633] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be updated. [ 838.521540] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.521684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.521761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.522383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.522580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.532120] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: IN_PROGRESS for 2s [ 838.585024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 244613f0-50a4-49be-8fcd-cda9fbfc74e0 with status ACTIVE [ 838.585377] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.586023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.586023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.586023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.586023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.586413] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.586413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.586413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.586584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.586584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.586837] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.588019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.588019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.588019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.588019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.588019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 244613f0-50a4-49be-8fcd-cda9fbfc74e0 is going to be updated. [ 838.590052] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.610253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.610253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.610253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.610485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.610854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.610854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-244613f0-50a4-49be-8fcd-cda9fbfc74e0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.984166] env[64436]: INFO networking_nsxv3.common.synchronization [req-f723a273-1b4a-44f8-8b51-a6aa7949ebe3 req-b07ef0f7-ae7b-4ece-894c-6a95f1591159 tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 838.984421] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 838.985242] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.985730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.985730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.985730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.985886] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.985946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.986036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.986228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.986360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.986476] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.093538] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.093795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.093795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.094112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.094112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.094207] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 839.120763] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.120908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.120982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.121218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.121359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.129476] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 839.490579] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.993430] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.496770] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.496905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.496950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.497362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.497362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.497362] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 840.522656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.522656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.522656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.522656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.522656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.531058] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 840.539652] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 840.539889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.540060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.540288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.540502] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.540628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.540721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.540894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.540992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.541132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.541323] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.541450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.541479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.541624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.541774] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.541875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.541937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.542090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.542167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.542288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.542386] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.543202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.543373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.543525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.543628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.543701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.543855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.543936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.544040] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.046346] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af8c995-71f2-4efa-a95d-9e0e461fe445: rpc.has_security_group_logging(os_id): False [ 841.047686] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.065207] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.065349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.065424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.065764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.065764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.065969] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.066109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.066166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.066360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.066451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.066681] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.066750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.066804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.066957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.067056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.067250] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.067354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.067423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.067569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.067641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.067754] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be created. [ 841.124656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.124898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.124898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.125591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.125591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.139230] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: IN_PROGRESS for 2s [ 841.144872] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 841.145426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.145882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.147704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.147704] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.147704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.147704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.147704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.147704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.147704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.147704] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.549790] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.653497] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.653706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.653791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.653979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.654256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.654404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.654509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.654626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.654720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.655371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.655371] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.655371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.655371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.655371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.655767] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.655767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.655767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.655767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.656106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.656106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.656106] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.052281] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.052574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.052574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.052804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.052917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.053053] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be updated. [ 842.080516] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.080743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.080834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.081074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.081228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.089297] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: IN_PROGRESS for 2s [ 842.158978] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a22f030d-b590-48f1-adde-d139f2aa31d4: rpc.has_security_group_logging(os_id): False [ 842.176544] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.176544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.176769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.178131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.178131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.178131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.178131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.178131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.178131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.178131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.178565] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.178800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.179491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.179491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.179491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.179708] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.179805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.179933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.180175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.180345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.180543] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 842.251476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.251680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.251805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.251949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.252150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.264138] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 842.540032] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 842.540376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.150806] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 843.151138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.151138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.151868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.151868] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.654026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.654184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.781612] env[64436]: INFO networking_nsxv3.common.synchronization [req-9ff5b30f-e9e0-46a5-8179-cc250f267249 req-49ed3010-a744-4e2c-a4fb-734ac0a0c42c tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_members [ 843.782221] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_members [ 843.782541] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b20bfe1-a213-442b-9906-0002d7f3fe25 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.782844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.782844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.782999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.783207] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.783317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.783381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.783521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.783601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.783688] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.099931] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 844.100249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.100308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.100489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.100729] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.100858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.100929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.101137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.101225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.101313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.101403] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.278079] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 844.278384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.285983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.286204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.286282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.286500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.286592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.287424] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.287424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.287424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.287424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.287424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.287424] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 already deleted. [ 844.287424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.370021] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.370021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.370021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.370021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.370021] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.370021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.370021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.370021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.370021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.370666] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.370666] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.370666] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.370666] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.370666] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.370666] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.370847] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.395672] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.395953] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.396131] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.396316] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.396666] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-299f6459-0af5-4623-97cf-3ec9be08a0f2 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.396844] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.396968] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.397315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.397463] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('299f6459-0af5-4623-97cf-3ec9be08a0f2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.605289] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.605507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.605507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.605730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.606252] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.606252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.606252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.606440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.606503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.606590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.606821] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.606876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.606911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.607055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.607199] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.607293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.607355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.607497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.607578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.608030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.608030] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.900107] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.900424] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.900587] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.901022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.901177] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.901345] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 299f6459-0af5-4623-97cf-3ec9be08a0f2 not found, creating... [ 844.901768] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.902017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.902172] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.902423] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.902666] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.903119] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.903316] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.903445] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.903724] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.903955] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.904197] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 299f6459-0af5-4623-97cf-3ec9be08a0f2 is going to be created. [ 844.923493] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.923732] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.923943] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.924168] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.924412] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.924650] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.112807] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af8c995-71f2-4efa-a95d-9e0e461fe445: rpc.has_security_group_logging(os_id): False [ 845.133966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.134793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.134793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.134793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.134793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.134793] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.135346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.135346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.135346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.135346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.135346] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.135524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.135524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.135640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.135715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.135933] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.136046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.136110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.136291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.136343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.136432] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be updated. [ 845.213490] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.213490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.213490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.213490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.213762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.229237] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: IN_PROGRESS for 2s [ 845.642350] env[64436]: INFO networking_nsxv3.common.synchronization [req-9ff5b30f-e9e0-46a5-8179-cc250f267249 req-425193c2-3a2f-4a37-8be5-758afd5c0b3b service nova] Enqueued Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_rules [ 845.642672] env[64436]: INFO networking_nsxv3.common.synchronization [req-9ff5b30f-e9e0-46a5-8179-cc250f267249 req-425193c2-3a2f-4a37-8be5-758afd5c0b3b service nova] Enqueued Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_members [ 845.642791] env[64436]: INFO networking_nsxv3.common.synchronization [req-9ff5b30f-e9e0-46a5-8179-cc250f267249 req-425193c2-3a2f-4a37-8be5-758afd5c0b3b service nova] Enqueued Resource ID: 299f6459-0af5-4623-97cf-3ec9be08a0f2 with Priority: HIGHEST for action port [ 845.643456] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_rules [ 845.643613] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_members [ 845.643709] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 299f6459-0af5-4623-97cf-3ec9be08a0f2 with Priority: HIGHEST for action port [ 845.644704] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b20bfe1-a213-442b-9906-0002d7f3fe25 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.644856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.644933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.645119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.645201] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.646965] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b20bfe1-a213-442b-9906-0002d7f3fe25 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.647195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.647325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.647535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.647840] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.647960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.648079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.648249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.648475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.648542] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.650762] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-299f6459-0af5-4623-97cf-3ec9be08a0f2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.651828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.651934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.652247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.652358] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('299f6459-0af5-4623-97cf-3ec9be08a0f2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.147854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b20bfe1-a213-442b-9906-0002d7f3fe25 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.148098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.151438] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.155737] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 299f6459-0af5-4623-97cf-3ec9be08a0f2 with status ACTIVE [ 846.155737] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.156596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.156731] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.157033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.157185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.157463] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.157579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.157762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.157959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.158105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.158323] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.158492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.158561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.158713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.158790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.158878] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 299f6459-0af5-4623-97cf-3ec9be08a0f2 is going to be updated. [ 846.181188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.181342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.181416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.181633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.181785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.181984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-299f6459-0af5-4623-97cf-3ec9be08a0f2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.583436] env[64436]: INFO networking_nsxv3.common.synchronization [req-300c96d2-cc7e-4c98-a98c-a6f21cf7f4f8 req-5892e4d3-0cbb-4f30-b06c-b766c7461e52 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_members [ 846.583436] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_members [ 846.583436] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.583436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.583436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.583436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.583436] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.583436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.583436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.584190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.584190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.584190] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.655277] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.710646] env[64436]: INFO networking_nsxv3.common.synchronization [req-88e32acf-4711-43b0-bd8a-cad42a904f2e req-692eee99-4a32-4547-8007-6c9b78b20aba tempest-ListImageFiltersTestJSON-829589829 tempest-ListImageFiltersTestJSON-829589829-project-member] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 846.711282] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGHEST for action security_group_members [ 846.711622] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.711759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.711826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.712118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.712346] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.712458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.712524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.712720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.712781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.712854] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.089438] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.089684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.089684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.090025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.090025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.090232] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.090319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.090378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.090591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.090591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.090869] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 439934dd-a8d0-443b-bef1-613de792a394 already deleted. [ 847.090869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.108100] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.108100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.108100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.108100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.108100] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.108100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.108100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.108444] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.108444] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.108559] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.108681] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.108863] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.108920] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.109055] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.109131] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.109366] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.129282] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.129282] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.129282] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.129282] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.129282] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-2c4c2029-fc18-4764-bb0c-0545c0ad1366 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.129282] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.129282] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.129282] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.129282] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c4c2029-fc18-4764-bb0c-0545c0ad1366',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.158343] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.159694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.159694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.159694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.159694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.159694] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 is going to be created. [ 847.183127] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.183230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.183393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.184025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.184025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.193336] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 in Status: UNINITIALIZED for 2s [ 847.215154] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.215338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.215420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.215713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.215868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.216116] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.216307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.216371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.216591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.216698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.216790] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be updated. [ 847.240890] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 847.241139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.245868] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.245868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.245868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.245868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.245868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.257170] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: IN_PROGRESS for 2s [ 847.633354] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.633663] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.633774] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.634130] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.634325] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.634493] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 2c4c2029-fc18-4764-bb0c-0545c0ad1366 not found, creating... [ 847.634854] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.635103] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.635265] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.635574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.635798] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.636241] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.636518] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.636682] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.636914] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.637121] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.637320] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 2c4c2029-fc18-4764-bb0c-0545c0ad1366 is going to be created. [ 847.659770] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.660174] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.660174] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.660861] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.660861] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.661027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.592906] env[64436]: INFO networking_nsxv3.common.synchronization [req-300c96d2-cc7e-4c98-a98c-a6f21cf7f4f8 req-74fbab92-69eb-4f13-b889-91ff2ac50501 service nova] Enqueued Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_rules [ 848.593222] env[64436]: INFO networking_nsxv3.common.synchronization [req-300c96d2-cc7e-4c98-a98c-a6f21cf7f4f8 req-74fbab92-69eb-4f13-b889-91ff2ac50501 service nova] Enqueued Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_members [ 848.593432] env[64436]: INFO networking_nsxv3.common.synchronization [req-300c96d2-cc7e-4c98-a98c-a6f21cf7f4f8 req-74fbab92-69eb-4f13-b889-91ff2ac50501 service nova] Enqueued Resource ID: 2c4c2029-fc18-4764-bb0c-0545c0ad1366 with Priority: HIGHEST for action port [ 848.594068] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_rules [ 848.596123] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_members [ 848.596315] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c4c2029-fc18-4764-bb0c-0545c0ad1366 with Priority: HIGHEST for action port [ 848.596965] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.597176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.597228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.597502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.597590] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.598559] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.598675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.598739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.598917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.599077] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.599174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.599248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.599394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.599505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.599647] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.600816] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c4c2029-fc18-4764-bb0c-0545c0ad1366 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.600943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.600987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.601164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.601243] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c4c2029-fc18-4764-bb0c-0545c0ad1366',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.104315] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.104793] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.104926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.105152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c4c2029-fc18-4764-bb0c-0545c0ad1366 with status ACTIVE [ 849.105354] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.105494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.105582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.105813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.105931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.106136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.106279] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.106456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.106667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.106810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.106997] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.107142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.107226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.107396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.107495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.107632] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c4c2029-fc18-4764-bb0c-0545c0ad1366 is going to be updated. [ 849.128039] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.128039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.128039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.128039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.128039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.128335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c4c2029-fc18-4764-bb0c-0545c0ad1366" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.204681] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 in Status: SUCCESS [ 849.204919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.205103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.205320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.205503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.205622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.205686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.205831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.205908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.205991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.206095] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.272038] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a in Status: SUCCESS [ 849.272252] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a deletion is rescheduled due to dependency. [ 849.272293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.609999] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.713482] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.939972] env[64436]: INFO networking_nsxv3.common.synchronization [req-1924e9cd-d60b-41b7-a1eb-bdf156a857a0 req-b34da6f2-0ecb-4fdb-a4ea-cf1feb6a5717 tempest-VolumesAdminNegativeTest-1750673227 tempest-VolumesAdminNegativeTest-1750673227-project-member] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_members [ 849.940573] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGHEST for action security_group_members [ 849.940931] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.941076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.941147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.941351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.941963] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.941963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.941963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.941963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.941963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.941963] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.114503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.114810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.114810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.115248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.115248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.115248] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 439934dd-a8d0-443b-bef1-613de792a394 is going to be created. [ 850.140446] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.140446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.140446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.140446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.140446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.147975] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 439934dd-a8d0-443b-bef1-613de792a394 in Status: UNINITIALIZED for 2s [ 850.217492] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b20bfe1-a213-442b-9906-0002d7f3fe25: rpc.has_security_group_logging(os_id): False [ 850.235236] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.235435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.235435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.235647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.235742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.236029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.236136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.236201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.236377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.236455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.237587] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 is going to be created. [ 850.292584] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.292877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.292877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.293152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.293375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.311191] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 in Status: IN_PROGRESS for 2s [ 850.445367] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.445367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.445367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.445606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.445638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.445854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.445982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.446362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.446362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.446362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.446524] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 is going to be updated. [ 850.476397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.476569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.476684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.476807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.476950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.486845] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: IN_PROGRESS for 2s [ 852.160389] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 439934dd-a8d0-443b-bef1-613de792a394 in Status: SUCCESS [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 852.160389] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.160389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.160389] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.323544] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 in Status: SUCCESS [ 852.323809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.500021] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23b08457-f786-4357-ae40-5bf7a012b659 in Status: SUCCESS [ 852.500488] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 deletion is rescheduled due to dependency. [ 852.500488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.663036] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.166439] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 439934dd-a8d0-443b-bef1-613de792a394: rpc.has_security_group_logging(os_id): False [ 853.183153] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.183334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 853.183373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.183564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 853.183656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 853.183893] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.183991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 853.184072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.184222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 853.184297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 853.184381] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 439934dd-a8d0-443b-bef1-613de792a394 is going to be created. [ 853.239998] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.240160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 853.240229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.240436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 853.242058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 853.251341] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 439934dd-a8d0-443b-bef1-613de792a394 in Status: IN_PROGRESS for 2s [ 853.960473] env[64436]: INFO networking_nsxv3.common.synchronization [req-7860e80d-3a8c-4494-afe1-c9a6a9cb4e6d req-8ba5c481-a05d-41d1-94b3-8abcacf8fbf8 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 853.961530] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 853.961961] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.962123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 853.962273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.962494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 853.962873] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.962873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 853.963091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.963212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 853.963344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 853.963425] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.328540] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-178 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.328882] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-178" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.328993] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-178" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.329498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-178" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.329854] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.330091] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.330323] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.330748] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.331000] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.331422] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.331658] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.331877] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.332049] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.332976] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.332976] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.332976] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.354744] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.354933] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 854.355153] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.355389] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-178" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.355770] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.356017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.356206] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.356660] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.356920] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.465529] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.465805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.465934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.466307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.466474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.467588] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.467812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.467812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.467981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.468119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.468222] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 already deleted. [ 854.468427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.863559] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.868038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.868038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.868038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.868038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.868038] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a not found, creating... [ 854.868038] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.868038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.868038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.868038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.868965] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.869629] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.872409] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.872409] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.876314] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.876314] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.876314] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a is going to be created. [ 854.895805] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.896205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.896360] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.897621] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.897621] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.897621] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.098041] env[64436]: INFO networking_nsxv3.common.synchronization [req-d2ee5e7f-28a8-4955-9c45-c0751bde7836 req-9cdae467-5b42-47e6-a5be-f1854b022fce tempest-ListServersNegativeTestJSON-435753161 tempest-ListServersNegativeTestJSON-435753161-project-member] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 855.098041] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 855.098041] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.098041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.098284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.098284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.101549] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.101549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.101549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.101549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.101549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.101549] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.132840] env[64436]: INFO networking_nsxv3.common.synchronization [req-bf5887be-1244-4ef5-a3a2-7eadd13f911a req-03f5d46b-2628-42df-bee7-09a31e426d7b tempest-ListServersNegativeTestJSON-435753161 tempest-ListServersNegativeTestJSON-435753161-project-member] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 855.132840] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGHEST for action security_group_members [ 855.132840] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.132840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.262903] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 439934dd-a8d0-443b-bef1-613de792a394 in Status: SUCCESS [ 855.263218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.603303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.606354] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.606354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.606354] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 855.654056] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.655028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.655028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.656754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.656754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.681782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 856.067050] env[64436]: INFO networking_nsxv3.common.synchronization [req-486d60a9-e1b6-4bc1-bad7-703bb0ff3d84 req-33a8f352-0e45-4ceb-9d36-91109d7cd0a9 tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 856.067642] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 856.067961] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.068211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.068328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.068620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.068841] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.069026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.069354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.069620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.069763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.069903] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.084582] env[64436]: INFO networking_nsxv3.common.synchronization [req-7860e80d-3a8c-4494-afe1-c9a6a9cb4e6d req-82f66b67-aa91-438a-a57a-8482491ef40f service nova] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_rules [ 856.084763] env[64436]: INFO networking_nsxv3.common.synchronization [req-7860e80d-3a8c-4494-afe1-c9a6a9cb4e6d req-82f66b67-aa91-438a-a57a-8482491ef40f service nova] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 856.087689] env[64436]: INFO networking_nsxv3.common.synchronization [req-7860e80d-3a8c-4494-afe1-c9a6a9cb4e6d req-82f66b67-aa91-438a-a57a-8482491ef40f service nova] Enqueued Resource ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with Priority: HIGHEST for action port [ 856.089015] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_rules [ 856.089015] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 856.089167] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with Priority: HIGHEST for action port [ 856.090750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.090750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.092662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.092662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.092662] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.093261] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.093828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.093997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.094291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.094596] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.096043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.096043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.096043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.096043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.096043] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.097342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.097342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.097342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.097342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.097342] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.572727] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.599919] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.600755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.600755] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.603183] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with status ACTIVE [ 856.603985] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.603985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.603985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.603985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.603985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.604435] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.604435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.604435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.604435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.604556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.604638] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.604732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.604849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.604921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.604991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.605086] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a is going to be updated. [ 856.625511] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.625729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.625729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.625934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.626088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.626253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.075212] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.107994] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.578317] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.578638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.578732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.579071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.579209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.579365] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 857.609220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.609563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.609563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.609679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.609772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.611187] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.611315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.611383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.611546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.611627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.611717] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be created. [ 857.627248] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 857.638664] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.638995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.639137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.639432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.639757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.661782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: UNINITIALIZED for 2s [ 857.690333] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 857.690976] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 deletion is rescheduled due to dependency. [ 857.690976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.690976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.691281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.692028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.692028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.692028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.692028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.692028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.692028] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.194794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.194956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.195041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.195266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.195359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.195553] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.195688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.195760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.196083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.196083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.196083] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be updated. [ 858.225250] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.225395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.225469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.225707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.225858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.236755] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: IN_PROGRESS for 2s [ 859.407650] env[64436]: INFO networking_nsxv3.common.synchronization [req-cd7a2906-9789-4ccd-b2ea-ef0ed78b2e00 req-1fbfe612-6b39-4d60-9684-df6791d68e33 tempest-ServersTestJSON-230956575 tempest-ServersTestJSON-230956575-project-member] Enqueued Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_members [ 859.409857] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_members [ 859.409857] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-80355bd7-8e39-4ae8-bf46-4d775230b0d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.409857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.409857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.409857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.409857] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.409857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.409857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.409857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.409857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.409857] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.639059] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 859.639059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.672052] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 859.672299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.672427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.672725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.673012] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.673157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.673291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.673478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.673602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.673705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.673819] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.753317] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.753618] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-204" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.753803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-204" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.755483] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-204" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.757100] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.757395] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.757577] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.757981] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.759019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.759019] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.759019] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.759348] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.760374] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.760374] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.760374] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.760374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.781169] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.781169] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.781169] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.781169] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-204" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.781169] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b87de3d0-38fa-4944-bcad-353ef146194d taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.781169] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.781169] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.782284] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.782600] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b87de3d0-38fa-4944-bcad-353ef146194d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.913856] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.913856] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.913856] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 already deleted. [ 859.913856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.176398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.176589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.176675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.176905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.177391] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.177627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.177760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.178035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.178177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.178321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.178684] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.178826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.178974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.179720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.179884] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.179992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.180065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.180216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.180304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.180390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.180503] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.252059] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 in Status: SUCCESS [ 860.252279] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 deletion is rescheduled due to dependency. [ 860.252393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.290022] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.290022] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b87de3d0-38fa-4944-bcad-353ef146194d not found, creating... [ 860.290022] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.290022] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.290913] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.290913] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.290913] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.290913] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.290913] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.290913] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b87de3d0-38fa-4944-bcad-353ef146194d is going to be created. [ 860.313654] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.313654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.313654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.313654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.313654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.313654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.686294] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4e86682-3d32-48f8-93bf-87bc28ad7f77: rpc.has_security_group_logging(os_id): False [ 860.704552] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.704768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.704813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.705018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.705123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.705321] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.705422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.705487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.705646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.705727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.705926] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.706095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.706095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.706271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.706319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.706483] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.706578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.706640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.706778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.706851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.706937] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be created. [ 860.764936] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.765143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.765186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.765384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.765585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.778299] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: IN_PROGRESS for 2s [ 861.155391] env[64436]: INFO networking_nsxv3.common.synchronization [req-cd7a2906-9789-4ccd-b2ea-ef0ed78b2e00 req-9e04b35f-66a8-4d43-b060-506fd1960867 service nova] Enqueued Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_rules [ 861.155727] env[64436]: INFO networking_nsxv3.common.synchronization [req-cd7a2906-9789-4ccd-b2ea-ef0ed78b2e00 req-9e04b35f-66a8-4d43-b060-506fd1960867 service nova] Enqueued Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_members [ 861.156022] env[64436]: INFO networking_nsxv3.common.synchronization [req-cd7a2906-9789-4ccd-b2ea-ef0ed78b2e00 req-9e04b35f-66a8-4d43-b060-506fd1960867 service nova] Enqueued Resource ID: b87de3d0-38fa-4944-bcad-353ef146194d with Priority: HIGHEST for action port [ 861.156770] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_rules [ 861.156975] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_members [ 861.157345] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b87de3d0-38fa-4944-bcad-353ef146194d with Priority: HIGHEST for action port [ 861.157748] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.157954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.158110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.158605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.158794] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.160316] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-80355bd7-8e39-4ae8-bf46-4d775230b0d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.160480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.160578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.160800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.160995] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.161143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.161243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.161745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.161745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.161745] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.162494] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b87de3d0-38fa-4944-bcad-353ef146194d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.162656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.162767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.162985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.163119] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b87de3d0-38fa-4944-bcad-353ef146194d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.665040] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.666383] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-80355bd7-8e39-4ae8-bf46-4d775230b0d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.666537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.666809] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b87de3d0-38fa-4944-bcad-353ef146194d with status ACTIVE [ 861.667052] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.667209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.667289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.667550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.667665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.667918] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.668517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.668656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.668904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.669034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.669591] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.669591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.669591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.669837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.669837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.669920] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b87de3d0-38fa-4944-bcad-353ef146194d is going to be updated. [ 861.692338] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.692689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.692689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.692776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.692926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.693067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b87de3d0-38fa-4944-bcad-353ef146194d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.173166] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.675467] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.675633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.675712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.675942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.676052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.676177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 is going to be created. [ 862.700111] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.700730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.700730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.700730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.700730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.714755] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 in Status: UNINITIALIZED for 2s [ 862.791376] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 862.791639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.785017] env[64436]: INFO networking_nsxv3.common.synchronization [req-53e38cae-1386-4225-a522-28dde02be0ee req-33536f18-b8d1-4dd9-9361-f9f423247127 tempest-ServerDiagnosticsNegativeTest-1796900892 tempest-ServerDiagnosticsNegativeTest-1796900892-project-member] Enqueued Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_members [ 863.785017] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_members [ 863.786558] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.786714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.787320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.787320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.787320] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.787647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.787647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.787647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.787757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.787785] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.256542] env[64436]: INFO networking_nsxv3.common.synchronization [req-8b7081b1-59de-4267-8a61-fdb914d641cd req-9db4db9e-a2ae-48c8-99d0-0c70f1f8b7de tempest-ServersAdminTestJSON-1461262248 tempest-ServersAdminTestJSON-1461262248-project-member] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 864.257457] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGHEST for action security_group_members [ 864.261783] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.261930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.262011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.262221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.262389] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.262497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.262568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.262704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.262791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.262876] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.291908] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.291908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.291908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.291908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.291908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.292700] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.292700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.292700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.292700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.292700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.292700] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 already deleted. [ 864.292700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.375008] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.375246] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.375604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.375694] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.375930] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.376100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.376223] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.376444] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.376593] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.376810] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.376929] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.377055] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.377166] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.377363] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.377421] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.377579] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.395874] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.396208] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.396208] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.396378] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-753" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.396693] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-5b02dfd8-ea44-4053-93f5-5d000e377b25 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.396863] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.396984] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.397350] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.397487] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b02dfd8-ea44-4053-93f5-5d000e377b25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.724353] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 in Status: SUCCESS [ 864.724549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.724720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.724944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.725158] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.725280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.725348] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.725567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.725695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.725752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.725831] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.765031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.765275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.765415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.765654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.765759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.766029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.766214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.766306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.766490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.766663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.766780] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be updated. [ 864.793174] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.793580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.793580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.793680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.794121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.801670] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: IN_PROGRESS for 2s [ 864.899391] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.899605] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.899747] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.900047] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.900277] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.900461] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 5b02dfd8-ea44-4053-93f5-5d000e377b25 not found, creating... [ 864.900823] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.901243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.901243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.901408] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.901556] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.901846] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.902016] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.902245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.902631] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.902631] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.902763] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 5b02dfd8-ea44-4053-93f5-5d000e377b25 is going to be created. [ 864.924219] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.924482] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.924581] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.924921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.925339] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.925452] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.181040] env[64436]: INFO networking_nsxv3.common.synchronization [req-99eba14a-de6d-4a59-ad1c-0a04d78e90a8 req-cccbc8dd-efad-4443-9fa4-5d8cac04cc85 tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 865.182029] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d with Priority: HIGHEST for action security_group_members [ 865.182029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfb4c1c6-2021-458b-840f-cd83ee502c3d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.182247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.182247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.182380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.182544] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.182648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.182715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.182864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.183532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.183532] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfb4c1c6-2021-458b-840f-cd83ee502c3d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.228732] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.686101] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.686280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.686411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.686618] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.686750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.686952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.687081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.687146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.687326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.687412] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.687504] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d is going to be updated. [ 865.713322] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.713498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.713536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.713737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.713883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.723154] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: IN_PROGRESS for 2s [ 865.732560] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80355bd7-8e39-4ae8-bf46-4d775230b0d4: rpc.has_security_group_logging(os_id): False [ 865.754138] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.754438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.754438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.754605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.754653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.754900] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.755015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.755070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.755236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.755315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.755403] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 is going to be created. [ 865.787275] env[64436]: INFO networking_nsxv3.common.synchronization [req-53e38cae-1386-4225-a522-28dde02be0ee req-439141c9-03d0-49f5-9799-5bb8a49054c7 service nova] Enqueued Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_rules [ 865.787478] env[64436]: INFO networking_nsxv3.common.synchronization [req-53e38cae-1386-4225-a522-28dde02be0ee req-439141c9-03d0-49f5-9799-5bb8a49054c7 service nova] Enqueued Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_members [ 865.787634] env[64436]: INFO networking_nsxv3.common.synchronization [req-53e38cae-1386-4225-a522-28dde02be0ee req-439141c9-03d0-49f5-9799-5bb8a49054c7 service nova] Enqueued Resource ID: 5b02dfd8-ea44-4053-93f5-5d000e377b25 with Priority: HIGHEST for action port [ 865.788386] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_rules [ 865.788620] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_members [ 865.788789] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b02dfd8-ea44-4053-93f5-5d000e377b25 with Priority: HIGHEST for action port [ 865.792730] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.792730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.792730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.792730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.792730] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.792730] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.793082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.793082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.793136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.798916] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.798916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.798916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.798916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.798916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.798916] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.798916] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b02dfd8-ea44-4053-93f5-5d000e377b25 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.799426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.799426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.799426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.799426] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b02dfd8-ea44-4053-93f5-5d000e377b25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.825045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.825045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.825045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.825045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.825045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.836510] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 in Status: IN_PROGRESS for 2s [ 866.301685] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.301996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.302230] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b02dfd8-ea44-4053-93f5-5d000e377b25 with status ACTIVE [ 866.302408] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.302545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.302622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.302844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.302939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.303111] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.303206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.303264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.303414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.303503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.303698] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.303795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.303853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.304018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.304125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.304213] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b02dfd8-ea44-4053-93f5-5d000e377b25 is going to be updated. [ 866.305311] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.343799] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.344007] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.344146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.344508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.344572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.344828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b02dfd8-ea44-4053-93f5-5d000e377b25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.809111] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.811020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeeb0085-3d91-4859-b6e8-d553406b2219 in Status: SUCCESS [ 866.811244] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 deletion is rescheduled due to dependency. [ 866.811369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.312423] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.312612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.312685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.312905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.312999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.313219] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 is going to be created. [ 867.334878] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.335014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.335095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.335342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.335505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.344172] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 in Status: UNINITIALIZED for 2s [ 867.733077] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d in Status: SUCCESS [ 867.733279] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfb4c1c6-2021-458b-840f-cd83ee502c3d deletion is rescheduled due to dependency. [ 867.733417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfb4c1c6-2021-458b-840f-cd83ee502c3d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.849517] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 in Status: SUCCESS [ 867.850112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.975370] env[64436]: INFO networking_nsxv3.common.synchronization [req-6331ad96-ea03-409f-8333-835697ea6887 req-d6fcbba1-f515-4282-b549-92c5bbc836c3 tempest-MigrationsAdminTest-163149722 tempest-MigrationsAdminTest-163149722-project-member] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 868.976163] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 868.976163] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.976388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.976388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.976510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.976991] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.976991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.976991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.977142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.977142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.977196] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.134028] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-69 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.137084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.137084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.137084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.137084] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.137084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.137084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.137084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.137084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.137084] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.137084] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.137084] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.137084] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.137084] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.137084] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.137084] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.156399] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.156568] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 869.156719] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.156904] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-69" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.157253] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-51db4609-051d-4b6c-8455-b2276d12c133 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.157435] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.157562] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.157826] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.157973] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51db4609-051d-4b6c-8455-b2276d12c133',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.353298] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 in Status: SUCCESS [ 869.353583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.353726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.353938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.354139] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.354257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.354323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.354569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.354569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.354693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.354723] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.479557] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.660555] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.660788] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.660944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.661585] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.661803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.662433] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.662433] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.662630] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.662768] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.662869] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.663417] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.664147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.664147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.664147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.664147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.664325] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 51db4609-051d-4b6c-8455-b2276d12c133 is going to be updated. [ 869.683491] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.683797] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.683873] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.684535] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.684771] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.685376] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.857313] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.857571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.857652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.858148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.858148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.858306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.858306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.858492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.858719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.858837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.858997] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.859138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.859172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.859316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.859463] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.859552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.859689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.859794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.859873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.860739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.860739] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.982325] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.363528] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 053dde8f-4d20-4a6f-8b2d-d0a125c40782: rpc.has_security_group_logging(os_id): False [ 870.383288] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.383431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.383499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.383714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.383806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.384021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.384239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.384311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.384473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.384553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.384779] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.384874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.384912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.385193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.385193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.385320] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.385419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.385482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.385620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.385697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.385781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 is going to be created. [ 870.439498] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.439641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.439641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.439837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.440118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.449927] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 in Status: IN_PROGRESS for 2s [ 870.462407] env[64436]: INFO networking_nsxv3.common.synchronization [None req-8fd63619-64d7-4183-9374-20976e17911b None None] Enqueued Resource ID: a0814175-7afb-4b60-b7f8-73eecde50a32 with Priority: HIGHEST for action port [ 870.462952] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0814175-7afb-4b60-b7f8-73eecde50a32 with Priority: HIGHEST for action port [ 870.463239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0814175-7afb-4b60-b7f8-73eecde50a32 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.463347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0814175-7afb-4b60-b7f8-73eecde50a32" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.463626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0814175-7afb-4b60-b7f8-73eecde50a32" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.463917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0814175-7afb-4b60-b7f8-73eecde50a32" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.463988] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0814175-7afb-4b60-b7f8-73eecde50a32',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.485434] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.485434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.485434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.485434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.485434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.485434] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be updated. [ 870.517159] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.517303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.517373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.517574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.518068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.534939] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: IN_PROGRESS for 2s [ 870.613049] env[64436]: INFO networking_nsxv3.common.synchronization [req-964ececf-53a7-4966-a3ad-16932930d412 req-4a7b6bd0-8d57-4c5c-b200-1a2ae653329e service nova] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_rules [ 870.613257] env[64436]: INFO networking_nsxv3.common.synchronization [req-964ececf-53a7-4966-a3ad-16932930d412 req-4a7b6bd0-8d57-4c5c-b200-1a2ae653329e service nova] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 870.613401] env[64436]: INFO networking_nsxv3.common.synchronization [req-964ececf-53a7-4966-a3ad-16932930d412 req-4a7b6bd0-8d57-4c5c-b200-1a2ae653329e service nova] Enqueued Resource ID: 51db4609-051d-4b6c-8455-b2276d12c133 with Priority: HIGHEST for action port [ 870.613974] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_rules [ 870.614073] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 870.614172] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51db4609-051d-4b6c-8455-b2276d12c133 with Priority: HIGHEST for action port [ 870.614438] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.614555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.614622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.614815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.614893] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.618249] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.618249] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.618249] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.618249] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-51db4609-051d-4b6c-8455-b2276d12c133 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.618249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.618249] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51db4609-051d-4b6c-8455-b2276d12c133',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.966890] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0814175-7afb-4b60-b7f8-73eecde50a32 [ 870.966890] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.966890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.967152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.967296] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.967425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.967551] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0814175-7afb-4b60-b7f8-73eecde50a32 already deleted. [ 870.970731] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0814175-7afb-4b60-b7f8-73eecde50a32" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.119793] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.120230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.122293] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.123193] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51db4609-051d-4b6c-8455-b2276d12c133 with status ACTIVE [ 871.124224] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.124685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.124876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.125145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.125236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.125539] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.125630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.125630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.125861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.125861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.126079] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.126179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.126236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.126375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.126440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.126607] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51db4609-051d-4b6c-8455-b2276d12c133 is going to be updated. [ 871.152993] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.153306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.153461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.153748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.154069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.154610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51db4609-051d-4b6c-8455-b2276d12c133" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.629143] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.986902] env[64436]: INFO networking_nsxv3.common.synchronization [None req-fb92b074-69e5-43d0-89dc-acc7137a4993 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 871.986902] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 871.986902] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.986902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.986902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.986902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.986902] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.111060] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b41c7f72-7c96-4964-b1da-7936121f4a00 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 872.111060] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 872.111060] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.111060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.134085] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.134085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.134085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.134085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.134085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.134085] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be updated. [ 872.160220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.160220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.160220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.160220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.160220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.172496] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 872.458422] env[64436]: INFO networking_nsxv3.common.synchronization [None req-748f976b-1f20-4821-9f06-9cbde0bb2f7c None None] Enqueued Resource ID: 0afb5f36-b0d5-4857-ae79-3131ef7a0107 with Priority: HIGHEST for action port [ 872.459851] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0afb5f36-b0d5-4857-ae79-3131ef7a0107 with Priority: HIGHEST for action port [ 872.461069] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-0afb5f36-b0d5-4857-ae79-3131ef7a0107 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.462031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0afb5f36-b0d5-4857-ae79-3131ef7a0107" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.462031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0afb5f36-b0d5-4857-ae79-3131ef7a0107" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.463159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0afb5f36-b0d5-4857-ae79-3131ef7a0107" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.463337] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0afb5f36-b0d5-4857-ae79-3131ef7a0107',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.470110] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 in Status: SUCCESS [ 872.470163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.504647] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.508070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.508070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.508070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.508070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.508070] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a already deleted. [ 872.508514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.508514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.508743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.508885] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.542826] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 872.542826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.967025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0afb5f36-b0d5-4857-ae79-3131ef7a0107 [ 872.967278] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.967412] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 872.967476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.967694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 872.968360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 872.968360] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0afb5f36-b0d5-4857-ae79-3131ef7a0107 already deleted. [ 872.968360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0afb5f36-b0d5-4857-ae79-3131ef7a0107" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.028207] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.028342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.028417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.028629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.028918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.029080] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a already deleted. [ 873.029185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.559353] env[64436]: INFO networking_nsxv3.common.synchronization [req-d4bc6d44-e4bb-461c-94a4-681d0d9081cf req-075d7a63-1623-4028-80a6-918e78a9cdf4 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_members [ 873.559353] env[64436]: INFO networking_nsxv3.common.synchronization [req-d4bc6d44-e4bb-461c-94a4-681d0d9081cf req-075d7a63-1623-4028-80a6-918e78a9cdf4 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 873.563740] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_members [ 873.563740] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 873.563740] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddc32f05-2651-4383-9fb6-3e4777f071b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.563740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.563740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.564171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.564171] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.564171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.564317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.564387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.564464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.564549] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.568069] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.568276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.568357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.568616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.569506] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.569506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.569506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.569506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.569506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.569506] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.626531] env[64436]: INFO networking_nsxv3.common.synchronization [req-d4bc6d44-e4bb-461c-94a4-681d0d9081cf req-075d7a63-1623-4028-80a6-918e78a9cdf4 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_rules [ 873.626748] env[64436]: INFO networking_nsxv3.common.synchronization [req-d4bc6d44-e4bb-461c-94a4-681d0d9081cf req-075d7a63-1623-4028-80a6-918e78a9cdf4 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_members [ 873.626890] env[64436]: INFO networking_nsxv3.common.synchronization [req-d4bc6d44-e4bb-461c-94a4-681d0d9081cf req-075d7a63-1623-4028-80a6-918e78a9cdf4 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_rules [ 873.627037] env[64436]: INFO networking_nsxv3.common.synchronization [req-d4bc6d44-e4bb-461c-94a4-681d0d9081cf req-075d7a63-1623-4028-80a6-918e78a9cdf4 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 873.627179] env[64436]: INFO networking_nsxv3.common.synchronization [req-d4bc6d44-e4bb-461c-94a4-681d0d9081cf req-075d7a63-1623-4028-80a6-918e78a9cdf4 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with Priority: HIGHEST for action port [ 873.628564] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_rules [ 873.628564] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_rules [ 873.628564] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with Priority: HIGHEST for action port [ 873.628564] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_members [ 873.628564] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 873.629147] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddc32f05-2651-4383-9fb6-3e4777f071b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.629147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.629147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.629147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.629348] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.630417] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.633027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.633027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.633027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.633027] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.633027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.633027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.633027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.633417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.633417] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.634061] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddc32f05-2651-4383-9fb6-3e4777f071b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.634152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.635243] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.635243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.068581] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.071451] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.135979] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.136113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.137010] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with status ACTIVE [ 874.137010] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.137010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.137010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.137010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.137010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.137654] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.137654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.137654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.137654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.137654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.137812] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.137812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.137812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.137960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.138064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.138105] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a is going to be updated. [ 874.139492] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddc32f05-2651-4383-9fb6-3e4777f071b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.139492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.164017] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.164430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.164430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.164589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.164649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.164909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.185114] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 874.185337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.185504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.185775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.185893] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.186201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.186201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.186365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.186365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.186423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.186935] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.310047] env[64436]: INFO networking_nsxv3.common.synchronization [req-4fc94349-6ad8-40b0-9b91-0e1a1074c253 req-1cef38a8-9e4c-4efb-bd2e-a955be3b5d47 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 874.311260] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 874.311794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.311794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.311938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.312167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.312355] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.312559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.312559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.312990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.312990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.313086] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.337327] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ab1181-be5b-4cf3-80a2-4f9d7eac2f25 req-1d812784-75ba-45c0-a963-ef30b0d9dea5 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_members [ 874.337888] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ab1181-be5b-4cf3-80a2-4f9d7eac2f25 req-1d812784-75ba-45c0-a963-ef30b0d9dea5 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 874.342837] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 with Priority: HIGHEST for action security_group_members [ 874.342837] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 874.342837] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddc32f05-2651-4383-9fb6-3e4777f071b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.343443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.343443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.343443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.404200] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ab1181-be5b-4cf3-80a2-4f9d7eac2f25 req-1d812784-75ba-45c0-a963-ef30b0d9dea5 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_rules [ 874.404399] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ab1181-be5b-4cf3-80a2-4f9d7eac2f25 req-1d812784-75ba-45c0-a963-ef30b0d9dea5 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 874.404557] env[64436]: INFO networking_nsxv3.common.synchronization [req-51ab1181-be5b-4cf3-80a2-4f9d7eac2f25 req-1d812784-75ba-45c0-a963-ef30b0d9dea5 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with Priority: HIGHEST for action port [ 874.405243] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_rules [ 874.405454] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 874.405777] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with Priority: HIGHEST for action port [ 874.405883] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.405959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.406177] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.406263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.406817] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.406923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.407090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.408024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.408141] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.571984] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.577470] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.693154] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.693154] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.693154] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.693154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.695025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.695025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.696988] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.696988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.696988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.696988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.696988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.696988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.696988] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.817681] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.817882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.818050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.818538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.818806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.819335] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.819573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.819670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.820025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.820025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.820117] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 874.847550] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.847550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.847550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.847849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.847849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.859425] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 874.912303] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a with status ACTIVE [ 874.912569] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.912717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.912814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.913066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.913162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.913375] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.913490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.913590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.913811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.913870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.914140] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.914222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.914283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.914425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.914502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.914589] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a is going to be updated. [ 874.933820] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.934065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.934203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.934459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.934611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.934804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0f73a51-b6c1-4bd7-9ac7-a998884ffc6a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.077814] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.077979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.078069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.078283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.078374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.078476] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 is going to be created. [ 875.079795] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.079914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.079984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.080201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.080310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.080395] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be updated. [ 875.119935] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.120583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.120697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.120916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.121087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.138844] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.139472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.139585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.139831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.139985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.144265] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 in Status: UNINITIALIZED for 2s [ 875.148595] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: IN_PROGRESS for 2s [ 875.203088] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 377c820a-e6ee-48bb-9450-abc7d40a08d0: rpc.has_security_group_logging(os_id): False [ 875.230280] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.230438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.230513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.230725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.256195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.256195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.256195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.256195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.256708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.256708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.256708] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be updated. [ 875.314835] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.314835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.314835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.315225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.315225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.327489] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 876.867751] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 876.868503] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 876.868688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.154826] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 in Status: SUCCESS [ 877.154826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.155010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.155271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.155531] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.156641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.156641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.156641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.156641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.156641] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.158281] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 877.158916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.159172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.159447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.159845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.159951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.160188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.160337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.160461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.161638] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.339757] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 877.340055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.663152] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.663586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.663586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.663765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.663765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.664101] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.664101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.664101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.664259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.664293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.664370] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 is going to be deleted. [ 877.665364] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.690928] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.691192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.691611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.691611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.691611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.691738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.692066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.692254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.692445] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.692543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.692595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.692724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.692867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.692943] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.168156] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.196021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.196240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.196342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.196484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.196589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.196882] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.196970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.197015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.197179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.197262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.197347] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 already deleted. [ 878.197428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.197531] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.198381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.198606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.198787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.198854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.198917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.201089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.201184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.201288] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.672613] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.672613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.672909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.672909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.673362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.673362] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be updated. [ 878.686296] env[64436]: INFO networking_nsxv3.common.synchronization [req-2726fcfd-d4e4-4147-8632-1648b11fb417 req-a55b03c1-b7ef-4b86-8614-a313ba248507 tempest-ServerDiagnosticsNegativeTest-1796900892 tempest-ServerDiagnosticsNegativeTest-1796900892-project-member] Enqueued Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_members [ 878.687018] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGHEST for action security_group_members [ 878.687417] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.687883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.687989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.688793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.689256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.689256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.689409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.690045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.690045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.690045] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.703398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.703398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.703398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.703934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.703934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.705740] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.705740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.705866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.706077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.706077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.706512] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.706512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.706828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.706828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.706828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.707724] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 already deleted. [ 878.707724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.707945] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddc32f05-2651-4383-9fb6-3e4777f071b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.723085] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: IN_PROGRESS for 2s [ 878.751965] env[64436]: INFO networking_nsxv3.common.synchronization [None req-b8cc722c-70c5-4b7d-a257-62e5cdd78a54 tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_rules [ 878.753055] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_rules [ 878.753219] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.753384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.753493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.753851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.753976] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.917676] env[64436]: INFO networking_nsxv3.common.synchronization [None req-a94ca688-1502-4365-92ff-48a0ba09dfd1 tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_rules [ 878.918479] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_rules [ 878.920865] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.921317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.193050] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.193380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.193380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.193508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.193602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.193854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.193944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.193987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.194157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.194319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.194319] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 is going to be updated. [ 879.211623] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddc32f05-2651-4383-9fb6-3e4777f071b9: rpc.has_security_group_logging(os_id): False [ 879.222788] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.222968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.223017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.223561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.223561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.232024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 in Status: IN_PROGRESS for 2s [ 879.234486] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.234486] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.234486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.234486] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 is going to be created. [ 879.263750] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ddc32f05-2651-4383-9fb6-3e4777f071b9], does not exist path=[/infra/domains/default/groups/ddc32f05-2651-4383-9fb6-3e4777f071b9]."\n}' [ 879.263750] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ddc32f05-2651-4383-9fb6-3e4777f071b9 [ 879.263750] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 879.281189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.281336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.281395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.281619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.281704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.281805] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f already deleted. [ 879.281890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.282063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.282522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.282522] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.303876] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.303876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.303876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.303876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.306734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.307165] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.307289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.308036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.308036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.308344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.308397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.308511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.308576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.308855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.309067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.309067] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddc32f05-2651-4383-9fb6-3e4777f071b9 is going to be created. [ 879.333814] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ddc32f05-2651-4383-9fb6-3e4777f071b9], does not exist path=[/infra/domains/default/groups/ddc32f05-2651-4383-9fb6-3e4777f071b9]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ddc32f05-2651-4383-9fb6-3e4777f071b9 [ 879.333814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddc32f05-2651-4383-9fb6-3e4777f071b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.333814] env[64436]: Traceback (most recent call last): [ 879.333814] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 879.333814] env[64436]: return func(*args, **kwargs) [ 879.333814] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 879.333814] env[64436]: res.raise_for_status() [ 879.333814] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 879.333814] env[64436]: raise HTTPError(http_error_msg, response=self) [ 879.333814] env[64436]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ddc32f05-2651-4383-9fb6-3e4777f071b9 [ 879.333814] env[64436]: During handling of the above exception, another exception occurred: [ 879.333814] env[64436]: Traceback (most recent call last): [ 879.333814] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 879.333814] env[64436]: listener.cb(fileno) [ 879.333814] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 879.333814] env[64436]: result = function(*args, **kwargs) [ 879.333814] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 879.333814] env[64436]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 879.333814] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 879.333814] env[64436]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 879.333814] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 879.333814] env[64436]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 879.333814] env[64436]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 879.333814] env[64436]: res.raise_for_status() [ 879.333814] env[64436]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 879.333814] env[64436]: raise HTTPError(http_error_msg, response=self) [ 879.333814] env[64436]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ddc32f05-2651-4383-9fb6-3e4777f071b9 [ 879.333814] env[64436]: Removing descriptor: 23 [ 879.527414] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d1f30c68-e769-45f5-9c05-dfc4c51c5838 None None] Enqueued Resource ID: ca43d48f-d089-4551-9bc4-66bab26e39d0 with Priority: HIGHEST for action port [ 879.528343] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca43d48f-d089-4551-9bc4-66bab26e39d0 with Priority: HIGHEST for action port [ 879.528343] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca43d48f-d089-4551-9bc4-66bab26e39d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.528508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca43d48f-d089-4551-9bc4-66bab26e39d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.528508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca43d48f-d089-4551-9bc4-66bab26e39d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.530329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca43d48f-d089-4551-9bc4-66bab26e39d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.530437] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca43d48f-d089-4551-9bc4-66bab26e39d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.805938] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.806134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.806134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.806345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.806431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.807048] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f already deleted. [ 879.807048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.032643] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca43d48f-d089-4551-9bc4-66bab26e39d0 [ 880.033067] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.033639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.033639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.033639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.033932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.033932] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca43d48f-d089-4551-9bc4-66bab26e39d0 already deleted. [ 880.033932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca43d48f-d089-4551-9bc4-66bab26e39d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.736390] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 880.736787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.736787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.736917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.737132] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.737259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.737862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.737862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.737862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.737862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.737862] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.739761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.739810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.739969] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.740084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.740148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.740288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.740363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.740449] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.245035] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 in Status: SUCCESS [ 881.245035] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 deletion is rescheduled due to dependency. [ 881.245035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.245035] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.245035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.246490] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.391648] env[64436]: INFO networking_nsxv3.common.synchronization [req-d1ed501e-69a6-4981-aeab-631cb93b6295 req-ad68431c-f4b9-4b3e-a08d-5ab2306ccb0c tempest-SecurityGroupRulesNegativeTestJSON-1320807283 tempest-SecurityGroupRulesNegativeTestJSON-1320807283-project-member] Enqueued Resource ID: d9e4adf2-af77-4f93-87ab-9f0b70c9e746 with Priority: HIGHEST for action security_group_rules [ 881.392162] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e4adf2-af77-4f93-87ab-9f0b70c9e746 with Priority: HIGHEST for action security_group_rules [ 881.392516] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.392597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.392874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.392926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.393214] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9e4adf2-af77-4f93-87ab-9f0b70c9e746',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.557609] env[64436]: INFO networking_nsxv3.common.synchronization [req-ecb84905-b26c-4ae3-bbaf-0e41b5af14f9 req-60b8ba65-15de-4c98-94d6-996a252c8ca0 tempest-SecurityGroupRulesNegativeTestJSON-1320807283 tempest-SecurityGroupRulesNegativeTestJSON-1320807283-project-member] Enqueued Resource ID: d9e4adf2-af77-4f93-87ab-9f0b70c9e746 with Priority: HIGHEST for action security_group_rules [ 881.558182] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e4adf2-af77-4f93-87ab-9f0b70c9e746 with Priority: HIGHEST for action security_group_rules [ 881.558496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.558593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.748745] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.918823] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.919107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.919107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.919306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.919391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.919484] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9e4adf2-af77-4f93-87ab-9f0b70c9e746 already deleted. [ 881.919587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.919740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.919950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.920056] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9e4adf2-af77-4f93-87ab-9f0b70c9e746',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.967785] env[64436]: INFO networking_nsxv3.common.synchronization [None req-af188090-8913-4a79-8b55-1b9c2c22b0c3 None None] Enqueued Resource ID: a5ddee94-9d66-4749-a702-641d83bb2354 with Priority: HIGHEST for action port [ 881.968160] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5ddee94-9d66-4749-a702-641d83bb2354 with Priority: HIGHEST for action port [ 881.968687] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5ddee94-9d66-4749-a702-641d83bb2354 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.968687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5ddee94-9d66-4749-a702-641d83bb2354" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.968687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5ddee94-9d66-4749-a702-641d83bb2354" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.968913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5ddee94-9d66-4749-a702-641d83bb2354" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.968913] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5ddee94-9d66-4749-a702-641d83bb2354',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.254411] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.254781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.254874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.255187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.258454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.258454] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be updated. [ 882.288224] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.288391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.288460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.288674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.288904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.299576] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: IN_PROGRESS for 2s [ 882.449233] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.449233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.449233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.449233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.449233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.449233] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9e4adf2-af77-4f93-87ab-9f0b70c9e746 already deleted. [ 882.449233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9e4adf2-af77-4f93-87ab-9f0b70c9e746" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.449233] env[64436]: INFO networking_nsxv3.common.synchronization [req-162653d8-2913-44ca-8de2-b1f3389038ca req-03371487-8fc2-4ec0-9a15-1c0d0d55c454 tempest-ServerRescueTestJSONUnderV235-585815671 tempest-ServerRescueTestJSONUnderV235-585815671-project-member] Enqueued Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 882.449233] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 with Priority: HIGHEST for action security_group_members [ 882.449601] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.449601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.472256] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5ddee94-9d66-4749-a702-641d83bb2354 [ 882.475915] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.475915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.475915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.475915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.475915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.475915] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5ddee94-9d66-4749-a702-641d83bb2354 already deleted. [ 882.475915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5ddee94-9d66-4749-a702-641d83bb2354" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.382476] env[64436]: INFO networking_nsxv3.common.synchronization [req-0735279b-c2fd-47a8-85eb-9e4ec0185acc req-fa5f01a6-d7f6-49b5-a9a9-9d7035a467fb tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 883.383526] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 883.383526] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.383526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.383526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.383794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.383938] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.384054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.386920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.387221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.387336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.387377] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.891476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.891673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.892101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.892528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.913136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.913413] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.913557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.913599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.913818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.913910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.914020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 883.943049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.943452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.943452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.943612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.943663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.953272] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 884.310414] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 884.310763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.311029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.311382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.312858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.313126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.313297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.313590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.313786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.313989] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.817272] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.817272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.817272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.817584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.837009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.837284] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.837416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.837629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.837707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.837766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.837854] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be updated. [ 884.863067] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.863067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.863067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.863067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.863067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.871819] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: IN_PROGRESS for 2s [ 885.254488] env[64436]: INFO networking_nsxv3.common.synchronization [None req-f759fbc9-72e3-4197-a9af-a62e9dd8fd1d None None] Enqueued Resource ID: c1dac8c8-0650-410c-99c0-012fcdb5b6f0 with Priority: HIGHEST for action port [ 885.255258] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dac8c8-0650-410c-99c0-012fcdb5b6f0 with Priority: HIGHEST for action port [ 885.255390] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1dac8c8-0650-410c-99c0-012fcdb5b6f0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.258105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1dac8c8-0650-410c-99c0-012fcdb5b6f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.258105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1dac8c8-0650-410c-99c0-012fcdb5b6f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.258105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1dac8c8-0650-410c-99c0-012fcdb5b6f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.258105] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1dac8c8-0650-410c-99c0-012fcdb5b6f0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.758224] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1dac8c8-0650-410c-99c0-012fcdb5b6f0 [ 885.758476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.758610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.758682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.758933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.759042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.759140] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1dac8c8-0650-410c-99c0-012fcdb5b6f0 already deleted. [ 885.759221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1dac8c8-0650-410c-99c0-012fcdb5b6f0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.962923] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 885.963181] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 deletion is rescheduled due to dependency. [ 885.964301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.880467] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 886.880467] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 deletion is rescheduled due to dependency. [ 886.880467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.880682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.880846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.881015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.881204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.881278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.881432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.881511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.881596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.881759] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4e86682-3d32-48f8-93bf-87bc28ad7f77 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.881895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.881895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.882115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.882266] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.882365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.882424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.882564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.882636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.883056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.883056] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.883648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.883820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.884215] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.884325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.884393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.884538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.884615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.884703] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.387114] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4e86682-3d32-48f8-93bf-87bc28ad7f77: rpc.has_security_group_logging(os_id): False [ 887.388470] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.388654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.388762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.389040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.389175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.389398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.389541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.389634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.389822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.389961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.390408] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be updated. [ 887.407845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.407990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.408151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.408392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.408523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.408850] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.408945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.408992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.409169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.409246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.409453] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.409548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.409607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.409747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.409847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.410091] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.410194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.410268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.410394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.410469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.410560] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be updated. [ 887.433998] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.434144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.434216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.434408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.434544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.442057] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: IN_PROGRESS for 2s [ 887.471528] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.471528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.471528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.471735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.471735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.483860] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: IN_PROGRESS for 2s [ 888.163493] env[64436]: INFO networking_nsxv3.common.synchronization [None req-092e4193-f59d-44a2-816b-5ff16c8d7a06 None None] Enqueued Resource ID: e0d6175d-d968-4d23-b579-affa7269fa1e with Priority: HIGHEST for action port [ 888.164252] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d6175d-d968-4d23-b579-affa7269fa1e with Priority: HIGHEST for action port [ 888.165593] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0d6175d-d968-4d23-b579-affa7269fa1e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.165593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0d6175d-d968-4d23-b579-affa7269fa1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.165744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0d6175d-d968-4d23-b579-affa7269fa1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.166425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0d6175d-d968-4d23-b579-affa7269fa1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.166544] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d6175d-d968-4d23-b579-affa7269fa1e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.670179] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0d6175d-d968-4d23-b579-affa7269fa1e [ 888.670466] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.670565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.670667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.670949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.670992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.671170] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0d6175d-d968-4d23-b579-affa7269fa1e already deleted. [ 888.671247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0d6175d-d968-4d23-b579-affa7269fa1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.453792] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 889.453792] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 deletion is rescheduled due to dependency. [ 889.453792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.496986] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 in Status: SUCCESS [ 889.497399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.497740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.498137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.498396] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4e86682-3d32-48f8-93bf-87bc28ad7f77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.023726] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.024082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.024082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.024317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.024317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.024380] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4e86682-3d32-48f8-93bf-87bc28ad7f77 is going to be deleted. [ 890.077062] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.077249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.077318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.078225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.078225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.078225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4e86682-3d32-48f8-93bf-87bc28ad7f77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 890.511276] env[64436]: INFO networking_nsxv3.common.synchronization [None req-167a944c-ed52-4cb5-b8e3-6f5504c8fac6 tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 890.511276] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 890.511990] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.511990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 890.511990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.511990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 890.512280] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.722037] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d7e1c1e1-42c7-4ad9-b05c-148742fddc87 tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 890.722037] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 890.723959] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.724309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.032725] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.033478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.033478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.033478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.033478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.033478] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e already deleted. [ 891.033478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.033674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.033752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.033819] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.554096] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.554305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.554305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.554525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.554614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.554705] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e already deleted. [ 891.554786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.006070] env[64436]: INFO networking_nsxv3.common.synchronization [req-6d2b7aa0-d82a-4a1c-a87d-d60edd8287d2 req-3109e79e-5fef-40eb-9b06-1d0d1bc85b43 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 892.006589] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 892.006931] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.007516] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.007593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.007801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.007971] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.008089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.008156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.008307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.008394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.008486] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.084383] env[64436]: INFO networking_nsxv3.common.synchronization [req-6d2b7aa0-d82a-4a1c-a87d-d60edd8287d2 req-3109e79e-5fef-40eb-9b06-1d0d1bc85b43 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 892.085996] env[64436]: INFO networking_nsxv3.common.synchronization [req-6d2b7aa0-d82a-4a1c-a87d-d60edd8287d2 req-3109e79e-5fef-40eb-9b06-1d0d1bc85b43 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 892.085996] env[64436]: INFO networking_nsxv3.common.synchronization [req-6d2b7aa0-d82a-4a1c-a87d-d60edd8287d2 req-3109e79e-5fef-40eb-9b06-1d0d1bc85b43 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 with Priority: HIGHEST for action port [ 892.086121] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 892.086271] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 892.086364] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 with Priority: HIGHEST for action port [ 892.086648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.086769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.086843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.087055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.087137] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.088179] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.088760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.088760] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a236d4f-2873-4efc-ae08-ca1d849adb13 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.088760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.088760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.088977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.089066] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a236d4f-2873-4efc-ae08-ca1d849adb13',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.324699] env[64436]: INFO networking_nsxv3.common.synchronization [req-4939b6d9-ef31-458d-b482-7e7fea02eebe req-10d32b38-8656-4dcd-8db6-5a3787ad0cd9 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 892.324699] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 892.324699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.324699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.324699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.324699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.324699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.325523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.325708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.325972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.326172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.326365] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.480044] env[64436]: INFO networking_nsxv3.common.synchronization [req-5c11fd31-b456-4f51-9adb-895c4638d23e req-21c0da2c-4d07-40fe-ac41-7eab51900b76 tempest-MigrationsAdminTest-163149722 tempest-MigrationsAdminTest-163149722-project-member] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 892.480044] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGHEST for action security_group_members [ 892.480044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.480044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.480044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.480044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.484023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.484023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.484023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.484023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.484344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.487555] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.520524] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.591611] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a236d4f-2873-4efc-ae08-ca1d849adb13 with status ACTIVE [ 892.591861] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.592009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.592092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.592384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.592484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.593265] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.593673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.594161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.594417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.594533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.594758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.594860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.594928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.595094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.595171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.595257] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 is going to be updated. [ 892.596496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.596592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.619458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.619458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.619458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.619458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.619636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.619740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.829932] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.830110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.830184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.830398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.830485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.830668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.830765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.830828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.830977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.831067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.831152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a already deleted. [ 892.831232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.990630] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.990796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.990870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.991128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.013021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.013021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.013021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.013240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.013294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.013375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.013464] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be updated. [ 893.022093] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.029364] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.029572] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.029705] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.030064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.030351] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.030524] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.030647] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.030877] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.032498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.033012] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.033012] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.033102] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.033160] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.033301] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.033968] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.033968] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.041107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.041254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.041897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.041897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.041897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.057179] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: IN_PROGRESS for 2s [ 893.064297] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.065155] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.065385] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.065634] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.066070] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ea3d3885-bf50-498f-98b2-1d12b0088888 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.066315] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.066480] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.066822] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.067458] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3d3885-bf50-498f-98b2-1d12b0088888',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.259722] env[64436]: INFO networking_nsxv3.common.synchronization [req-55b21244-bf2e-4e1a-a9d0-00d5a3a4348a req-83b70223-ec1f-4d1f-9b7b-1b18c70eebb6 tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 893.260281] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 893.260585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.260703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.260769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.260960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.261115] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.261209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.261268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.261423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.261507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.261596] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.524966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.525149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.525240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.526484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.526602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.526712] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be updated. [ 893.552336] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.552506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.552549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.552742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.552892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.562127] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: IN_PROGRESS for 2s [ 893.570248] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.570665] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.571282] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.571449] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.571664] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.571882] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ea3d3885-bf50-498f-98b2-1d12b0088888 not found, creating... [ 893.572305] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.572396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.572989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.572989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.572989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.574385] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.574580] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.574722] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.575055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.575159] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.575335] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ea3d3885-bf50-498f-98b2-1d12b0088888 is going to be created. [ 893.592634] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.592847] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.593218] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.593260] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.593501] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.593733] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.765949] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.766137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.766137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.766436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.789246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.789246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.789246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.789246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.789246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.789246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.789246] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 893.816387] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.816387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.816387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.816387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.816387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.823474] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 894.360059] env[64436]: INFO networking_nsxv3.common.synchronization [req-4939b6d9-ef31-458d-b482-7e7fea02eebe req-23048975-804e-48b6-8cc2-b635f8773e03 service nova] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 894.360059] env[64436]: INFO networking_nsxv3.common.synchronization [req-4939b6d9-ef31-458d-b482-7e7fea02eebe req-23048975-804e-48b6-8cc2-b635f8773e03 service nova] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 894.360059] env[64436]: INFO networking_nsxv3.common.synchronization [req-4939b6d9-ef31-458d-b482-7e7fea02eebe req-23048975-804e-48b6-8cc2-b635f8773e03 service nova] Enqueued Resource ID: ea3d3885-bf50-498f-98b2-1d12b0088888 with Priority: HIGHEST for action port [ 894.360059] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 894.360059] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 894.360059] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3d3885-bf50-498f-98b2-1d12b0088888 with Priority: HIGHEST for action port [ 894.362103] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.362340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.362497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.362945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.363134] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.364042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.364551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.364717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.364965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.365209] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.365432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.365668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.365899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.366098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.366325] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.367198] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea3d3885-bf50-498f-98b2-1d12b0088888 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.367546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.367733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.367961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.368154] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3d3885-bf50-498f-98b2-1d12b0088888',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.873266] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.874241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.874362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.874527] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea3d3885-bf50-498f-98b2-1d12b0088888 with status ACTIVE [ 894.874690] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.874795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.874861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.875082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.875254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.875355] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.875452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.875512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.875662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.875737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.875913] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.876015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.879200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.879200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.879200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.879200] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea3d3885-bf50-498f-98b2-1d12b0088888 is going to be updated. [ 894.897271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.897413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.897488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.897687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.898018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.898018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea3d3885-bf50-498f-98b2-1d12b0088888" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.066202] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 in Status: SUCCESS [ 895.066202] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 deletion is rescheduled due to dependency. [ 895.066202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.380407] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.495579] env[64436]: INFO networking_nsxv3.common.synchronization [req-d6010651-7a18-4ee8-aae5-fa9296bb5702 req-ac48d899-a9e5-4dd9-bb3f-5ee752fb3132 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 895.496155] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 895.496465] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.496570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.555010] env[64436]: INFO networking_nsxv3.common.synchronization [req-d6010651-7a18-4ee8-aae5-fa9296bb5702 req-ac48d899-a9e5-4dd9-bb3f-5ee752fb3132 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 895.555256] env[64436]: INFO networking_nsxv3.common.synchronization [req-d6010651-7a18-4ee8-aae5-fa9296bb5702 req-ac48d899-a9e5-4dd9-bb3f-5ee752fb3132 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 895.555306] env[64436]: INFO networking_nsxv3.common.synchronization [req-d6010651-7a18-4ee8-aae5-fa9296bb5702 req-ac48d899-a9e5-4dd9-bb3f-5ee752fb3132 tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 with Priority: HIGHEST for action port [ 895.555765] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_rules [ 895.555900] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 895.555999] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 with Priority: HIGHEST for action port [ 895.556292] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.556393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.556677] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.556677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.556839] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a236d4f-2873-4efc-ae08-ca1d849adb13 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.556941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.557017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.557471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.557610] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a236d4f-2873-4efc-ae08-ca1d849adb13',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.572423] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: SUCCESS [ 895.572967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.573547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.574055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.574288] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.574962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.575168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.576379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.576537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.576644] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.813022] env[64436]: INFO networking_nsxv3.common.synchronization [req-793ed921-d5d7-4f67-a91c-08c87ae25a29 req-d5ff25be-2170-4f1f-80c0-bd4aa9c3c8f5 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 895.813022] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 895.813022] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.813022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.813022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.814206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.814381] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.814836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.814836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.814836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.814836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.815121] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.833209] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 895.833409] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a deletion is rescheduled due to dependency. [ 895.833496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.883232] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.883394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.883456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.883674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.883768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.883868] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be created. [ 895.906315] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.906315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.906315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.906315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.906582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.914541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: UNINITIALIZED for 2s [ 896.060412] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a236d4f-2873-4efc-ae08-ca1d849adb13 with status ACTIVE [ 896.060717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.060847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.060847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.061078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.061176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.061386] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.061493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.061603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.061707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.061804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.061983] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.062087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.062152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.062291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.062366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.062629] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a236d4f-2873-4efc-ae08-ca1d849adb13 is going to be updated. [ 896.079146] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.081942] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.082118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.082197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.082498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.082611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.082767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a236d4f-2873-4efc-ae08-ca1d849adb13" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.318269] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.318463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.318507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.318738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.341938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.342903] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.343070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.343143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.343399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.343597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.343652] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 896.370507] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.370721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.370799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.371016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.371154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.381504] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 896.553473] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.553677] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.553807] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.554098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.554353] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.554515] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.554638] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.554860] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.555046] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.555279] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.555373] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.555488] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.555600] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.555714] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.555826] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.555960] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.576281] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.576892] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 896.576892] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.577181] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.577649] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ee9fcf71-be54-457e-a699-a30b1a77092f taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.577862] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.578007] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.578396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.578688] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9fcf71-be54-457e-a699-a30b1a77092f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.582246] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.639291] env[64436]: INFO networking_nsxv3.common.synchronization [None req-7f58e20b-475a-4976-be27-b90ad9a4b804 None None] Enqueued Resource ID: d8dad200-e76c-429b-bbbc-15c505f8564b with Priority: HIGHEST for action port [ 896.639594] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8dad200-e76c-429b-bbbc-15c505f8564b with Priority: HIGHEST for action port [ 896.640131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8dad200-e76c-429b-bbbc-15c505f8564b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.640396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8dad200-e76c-429b-bbbc-15c505f8564b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.640468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8dad200-e76c-429b-bbbc-15c505f8564b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.640716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8dad200-e76c-429b-bbbc-15c505f8564b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.640799] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8dad200-e76c-429b-bbbc-15c505f8564b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.084537] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.084537] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ee9fcf71-be54-457e-a699-a30b1a77092f not found, creating... [ 897.084537] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.084537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.085474] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.085474] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.085474] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.085474] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.085474] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.085474] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ee9fcf71-be54-457e-a699-a30b1a77092f is going to be created. [ 897.089481] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.089594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.089659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.089996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.089996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.089996] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be updated. [ 897.107640] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.107888] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.107990] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.108333] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.108565] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.108789] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.115123] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.115244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.115312] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.115499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.115641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.123180] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: IN_PROGRESS for 2s [ 897.144824] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8dad200-e76c-429b-bbbc-15c505f8564b [ 897.145053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.145241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.145320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.145528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.145611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.145703] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8dad200-e76c-429b-bbbc-15c505f8564b already deleted. [ 897.146730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8dad200-e76c-429b-bbbc-15c505f8564b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.838121] env[64436]: INFO networking_nsxv3.common.synchronization [req-793ed921-d5d7-4f67-a91c-08c87ae25a29 req-885f4fa7-f361-4404-81eb-e0f292f6efdb service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 897.839172] env[64436]: INFO networking_nsxv3.common.synchronization [req-793ed921-d5d7-4f67-a91c-08c87ae25a29 req-885f4fa7-f361-4404-81eb-e0f292f6efdb service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 897.839352] env[64436]: INFO networking_nsxv3.common.synchronization [req-793ed921-d5d7-4f67-a91c-08c87ae25a29 req-885f4fa7-f361-4404-81eb-e0f292f6efdb service nova] Enqueued Resource ID: ee9fcf71-be54-457e-a699-a30b1a77092f with Priority: HIGHEST for action port [ 897.840057] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 897.840127] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 897.840229] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee9fcf71-be54-457e-a699-a30b1a77092f with Priority: HIGHEST for action port [ 897.840510] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.840628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.841022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.841022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.841119] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.841905] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.841999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.843231] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee9fcf71-be54-457e-a699-a30b1a77092f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.844197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.844197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.844268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.844855] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9fcf71-be54-457e-a699-a30b1a77092f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.922901] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 897.923159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.923316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.923518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.923773] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.923900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.923972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.924166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.924252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.924338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.924430] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.346120] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.346275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.346459] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee9fcf71-be54-457e-a699-a30b1a77092f with status ACTIVE [ 898.346632] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.346740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.346808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.347063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.347158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.347337] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.347435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.347499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.347689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.347724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.347899] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.347989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.348072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.348215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.348293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.348375] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee9fcf71-be54-457e-a699-a30b1a77092f is going to be updated. [ 898.371799] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.371963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.372070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.372275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.372410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.372572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee9fcf71-be54-457e-a699-a30b1a77092f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.392165] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 898.392354] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 898.392471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.392634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.392840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.393046] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.393173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.393241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.393398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.393536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.393644] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.427595] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.494051] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d3e67cb3-70b5-4fb7-90ab-5880873aeeb0 None None] Enqueued Resource ID: 6fdf25e6-304d-4915-8de0-fd99086a054b with Priority: HIGHEST for action port [ 898.494912] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fdf25e6-304d-4915-8de0-fd99086a054b with Priority: HIGHEST for action port [ 898.495303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fdf25e6-304d-4915-8de0-fd99086a054b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.495573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fdf25e6-304d-4915-8de0-fd99086a054b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.495745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fdf25e6-304d-4915-8de0-fd99086a054b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.496432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fdf25e6-304d-4915-8de0-fd99086a054b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.496432] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fdf25e6-304d-4915-8de0-fd99086a054b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.897253] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.931609] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a7055f1-b6d2-4437-9167-b5ee510dd08a: rpc.has_security_group_logging(os_id): False [ 898.949267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.949414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.949490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.949753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.949856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.950056] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.950165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.950267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.950448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.950539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.950633] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be created. [ 898.998127] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fdf25e6-304d-4915-8de0-fd99086a054b [ 898.998736] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.998736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.998736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.998954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.998954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.999088] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fdf25e6-304d-4915-8de0-fd99086a054b already deleted. [ 898.999136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fdf25e6-304d-4915-8de0-fd99086a054b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.002874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.002874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.002969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.003165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.003417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.013062] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: IN_PROGRESS for 2s [ 899.131666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: IN_PROGRESS for 4s [ 899.399796] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.902487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.903266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.903425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.903701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.903843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.903953] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 899.931302] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.931302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.931302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.931302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.931302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.939617] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 900.226682] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a5b98e-e437-474a-b237-b40e3ca1ac38 req-282b6d6e-20bb-4300-966b-ca13ba2599fb tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 900.227715] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 900.228853] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.229073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.229186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.229896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.229896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.229896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.229896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.230113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.230113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.230170] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.637448] env[64436]: INFO networking_nsxv3.common.synchronization [req-372434f4-612f-483f-9836-55c5ac310fbe req-cf3b689e-5bd9-4faa-b435-b201368c2ab5 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 900.638038] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 900.638303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.638415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.638675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.638749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.638849] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.643113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.643520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.643520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.643632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.643669] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.735819] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.735978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.736065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.736311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.736486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.736565] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.736692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.736734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.736863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.736939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.737049] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 900.761282] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.761432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.761506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.761724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.761885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.769852] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 901.028280] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 901.028542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.146261] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: SUCCESS [ 901.146261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.146261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.146261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.146261] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.146261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.146261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.146879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.147052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.147131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.147237] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.150183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.150456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.150697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.150825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.150923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.151148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.151330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.151456] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.153262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.153262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.153262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.153262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.172057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.172057] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.172057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.172057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.172057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.172057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.172463] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 901.350166] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.350166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.350166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.350166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.350166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.353742] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.357034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.357034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.357034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.357034] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.357034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.357034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.357034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.357034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.357034] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.357034] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.357034] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.357034] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.357034] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.357034] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.357034] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.370037] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 901.376593] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.378083] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.378083] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.378083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-344" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.378083] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ddb41486-7d5f-4199-99f9-fcd69af955a7 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.378083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.378083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.378432] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.378432] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddb41486-7d5f-4199-99f9-fcd69af955a7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.654019] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.657985] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.687704] env[64436]: INFO networking_nsxv3.common.synchronization [req-aed99813-0ae7-4219-aa5f-c8167e1f312a req-bea1f1df-8174-4520-aaf6-2f7016d5bfff tempest-AttachInterfacesUnderV243Test-456616419 tempest-AttachInterfacesUnderV243Test-456616419-project-member] Enqueued Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 901.691433] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 with Priority: HIGHEST for action security_group_members [ 901.692385] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.692617] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.692787] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.693150] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.693437] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.693684] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.693830] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.694095] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.694295] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.694521] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.694670] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.694779] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.698146] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.698310] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.698453] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.698608] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.700563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ec0ad55-b4c7-4db0-9d96-64678434dae2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.700718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.716710] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.716961] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.717209] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.717455] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.717866] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-20152e6d-3b65-4bc9-be5e-f166ac468556 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.718228] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.718371] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.718748] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.718937] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20152e6d-3b65-4bc9-be5e-f166ac468556',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.884106] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.884106] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ddb41486-7d5f-4199-99f9-fcd69af955a7 not found, creating... [ 901.884106] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.884106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.884601] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.884601] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.884601] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.884601] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.885485] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.885845] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ddb41486-7d5f-4199-99f9-fcd69af955a7 is going to be created. [ 901.908493] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.908493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.908493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.908493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.908493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.908493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.955580] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 901.956061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.956061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.956299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.956523] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.956643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.956973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.956973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.956973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.957171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.957171] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.156409] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ec0ad55-b4c7-4db0-9d96-64678434dae2: rpc.has_security_group_logging(os_id): False [ 902.163614] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.173542] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.173685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.173765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.174000] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.204343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.204343] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.204343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.204343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.204343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.204343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.204343] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be updated. [ 902.226019] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.226019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 20152e6d-3b65-4bc9-be5e-f166ac468556 not found, creating... [ 902.226019] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.226019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.226528] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.226528] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.226528] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.226528] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.226528] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.226528] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 20152e6d-3b65-4bc9-be5e-f166ac468556 is going to be created. [ 902.244927] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.247054] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.247054] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.247054] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.247054] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.247054] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.266218] env[64436]: INFO networking_nsxv3.common.synchronization [None req-161a2393-1965-4fe0-831d-ac6db980e82f None None] Enqueued Resource ID: d87f65c7-2e62-44cb-96bd-106d8da5fc36 with Priority: HIGHEST for action port [ 902.266218] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.266218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.266218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.266218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.266684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.268384] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87f65c7-2e62-44cb-96bd-106d8da5fc36 with Priority: HIGHEST for action port [ 902.269184] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d87f65c7-2e62-44cb-96bd-106d8da5fc36 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.269517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d87f65c7-2e62-44cb-96bd-106d8da5fc36" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.269710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d87f65c7-2e62-44cb-96bd-106d8da5fc36" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.270092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d87f65c7-2e62-44cb-96bd-106d8da5fc36" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.270307] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d87f65c7-2e62-44cb-96bd-106d8da5fc36',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.287814] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: IN_PROGRESS for 2s [ 902.463080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.463080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.463080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.463080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.463080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.464078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.464078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.464078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.464423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.464701] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.622356] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a5b98e-e437-474a-b237-b40e3ca1ac38 req-94b5928a-b5c6-4526-9889-630d27b4c225 service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 902.622555] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a5b98e-e437-474a-b237-b40e3ca1ac38 req-94b5928a-b5c6-4526-9889-630d27b4c225 service nova] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 902.622697] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a5b98e-e437-474a-b237-b40e3ca1ac38 req-94b5928a-b5c6-4526-9889-630d27b4c225 service nova] Enqueued Resource ID: ddb41486-7d5f-4199-99f9-fcd69af955a7 with Priority: HIGHEST for action port [ 902.622969] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_rules [ 902.623114] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 902.623210] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb41486-7d5f-4199-99f9-fcd69af955a7 with Priority: HIGHEST for action port [ 902.623858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.623927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.623965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.630850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.631020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.632641] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.632749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.632994] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddb41486-7d5f-4199-99f9-fcd69af955a7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.633123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.633191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.633402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.633475] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddb41486-7d5f-4199-99f9-fcd69af955a7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.667468] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.667721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.667721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.667895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.667985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.668104] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be updated. [ 902.696028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.696028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.696028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.696028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.696028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.704349] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: IN_PROGRESS for 2s [ 902.772659] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d87f65c7-2e62-44cb-96bd-106d8da5fc36 [ 902.773447] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.773447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.773447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.773653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.773758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.773955] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d87f65c7-2e62-44cb-96bd-106d8da5fc36 already deleted. [ 902.774126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d87f65c7-2e62-44cb-96bd-106d8da5fc36" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.782532] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 902.786952] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 deletion is rescheduled due to dependency. [ 902.786952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.786952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.786952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.786952] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.786952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.786952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.786952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.786952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.786952] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.969419] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f75433d-92b0-49c0-b145-a45f748925ab: rpc.has_security_group_logging(os_id): False [ 902.985663] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.985818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.985914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.986169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.986264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.986464] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.986563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.986772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.986772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.987012] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.987012] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.987116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.987179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.987309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.987376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.987600] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.987685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.987782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.987829] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.987978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.987978] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 903.002037] env[64436]: INFO networking_nsxv3.common.synchronization [req-372434f4-612f-483f-9836-55c5ac310fbe req-7c8e2c19-abb9-42cf-b141-f0453b46625a service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 903.002232] env[64436]: INFO networking_nsxv3.common.synchronization [req-372434f4-612f-483f-9836-55c5ac310fbe req-7c8e2c19-abb9-42cf-b141-f0453b46625a service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 903.002374] env[64436]: INFO networking_nsxv3.common.synchronization [req-372434f4-612f-483f-9836-55c5ac310fbe req-7c8e2c19-abb9-42cf-b141-f0453b46625a service nova] Enqueued Resource ID: 20152e6d-3b65-4bc9-be5e-f166ac468556 with Priority: HIGHEST for action port [ 903.002759] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 903.002759] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 903.002842] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20152e6d-3b65-4bc9-be5e-f166ac468556 with Priority: HIGHEST for action port [ 903.004650] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.004650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.004650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.004804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.004804] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.005596] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.005694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.005929] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-20152e6d-3b65-4bc9-be5e-f166ac468556 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.006019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.006019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.006191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.006264] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20152e6d-3b65-4bc9-be5e-f166ac468556',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.043455] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.043587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.043625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.043831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.044082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.054898] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 903.137028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.137179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.137737] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddb41486-7d5f-4199-99f9-fcd69af955a7 with status ACTIVE [ 903.137917] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.138039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.138110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.138317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.138504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.138627] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.138673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.138726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.138876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.139091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.139305] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.139403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.139484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.139646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.139724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.139832] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddb41486-7d5f-4199-99f9-fcd69af955a7 is going to be updated. [ 903.167888] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.168189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.168189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.168470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.168604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.168769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddb41486-7d5f-4199-99f9-fcd69af955a7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.288158] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.378139] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 903.378139] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 deletion is rescheduled due to dependency. [ 903.378139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.378139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.378139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.378418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.378418] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.378501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.378627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.378723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.378827] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.414942] env[64436]: INFO networking_nsxv3.common.synchronization [req-c13a3761-9d3b-4708-b5db-a280d7f8ad3b req-347440ff-8b80-4736-949e-0e3ad6bd6dd6 tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_members [ 903.415064] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_members [ 903.415436] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.415606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.415653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.415869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.416040] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.416146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.416211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.416360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.416445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.416534] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.509603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.509762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.511162] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20152e6d-3b65-4bc9-be5e-f166ac468556 with status ACTIVE [ 903.511445] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.511620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.511716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.512038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.512585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.512692] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.512769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.512820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.512968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.513058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.513248] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.513346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.513398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.513540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.513623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.513693] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20152e6d-3b65-4bc9-be5e-f166ac468556 is going to be updated. [ 903.533049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.533239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.533364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.533880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.533880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.533880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20152e6d-3b65-4bc9-be5e-f166ac468556" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.791703] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.851240] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.851841] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.852182] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.852624] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.853092] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.853672] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.854098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.857018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.857018] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.857018] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.857018] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.857018] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.857018] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.857018] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.857018] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.857018] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.881048] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.881048] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.881048] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.881048] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-961" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.881048] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.881048] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.881048] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.881048] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.881048] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5678b67b-44d5-4fef-98c8-c4d9b5ba51ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.882107] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.920155] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.920155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.920155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.920419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.920419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.920540] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.920644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.920644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.920809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.920854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.920937] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f already deleted. [ 903.921030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.292755] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.293119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.293119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.293317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.293317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.293403] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 904.307419] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: SUCCESS [ 904.307419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.307419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.307419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.307419] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.320844] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.321207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.321951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.322287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.322525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.330588] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 904.387024] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.387024] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.387024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.387024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.387024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.387024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.387024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 5678b67b-44d5-4fef-98c8-c4d9b5ba51ba not found, creating... [ 904.387024] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.387024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.387024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.395931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.395931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.395931] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.395931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.395931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.395931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.395931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.395931] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 5678b67b-44d5-4fef-98c8-c4d9b5ba51ba is going to be created. [ 904.416604] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.416604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.416604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.416604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.416604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.416604] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.583114] env[64436]: INFO networking_nsxv3.common.synchronization [None req-256ceb4f-cff5-4220-a9ca-566a72bc7c6f None None] Enqueued Resource ID: dc7fe59e-633d-4614-8ffc-3d25cb011608 with Priority: HIGHEST for action port [ 904.583114] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7fe59e-633d-4614-8ffc-3d25cb011608 with Priority: HIGHEST for action port [ 904.583114] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc7fe59e-633d-4614-8ffc-3d25cb011608 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.583114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc7fe59e-633d-4614-8ffc-3d25cb011608" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.583114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc7fe59e-633d-4614-8ffc-3d25cb011608" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.583114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc7fe59e-633d-4614-8ffc-3d25cb011608" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.583663] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc7fe59e-633d-4614-8ffc-3d25cb011608',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.713561] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 in Status: SUCCESS [ 904.713778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.713936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.714193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.714457] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.714913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.714988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.715260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.715385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.715563] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.826998] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.827165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.827876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.827876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.827876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.827876] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be deleted. [ 904.879142] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.879224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.879333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.879477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.879682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.879682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.896477] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.896560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.896593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.896992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.896992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.897100] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 904.926967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.927250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.927323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.927536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.927759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.936197] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 905.070825] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 905.070971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.086457] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc7fe59e-633d-4614-8ffc-3d25cb011608 [ 905.086742] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.086902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.086980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.087274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.087379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.087475] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc7fe59e-633d-4614-8ffc-3d25cb011608 already deleted. [ 905.087556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc7fe59e-633d-4614-8ffc-3d25cb011608" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.096789] env[64436]: INFO networking_nsxv3.common.synchronization [req-c13a3761-9d3b-4708-b5db-a280d7f8ad3b req-cb38bb6e-6c39-4d4c-8d17-8a5f41bd0ed7 service nova] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_rules [ 905.097049] env[64436]: INFO networking_nsxv3.common.synchronization [req-c13a3761-9d3b-4708-b5db-a280d7f8ad3b req-cb38bb6e-6c39-4d4c-8d17-8a5f41bd0ed7 service nova] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_members [ 905.097220] env[64436]: INFO networking_nsxv3.common.synchronization [req-c13a3761-9d3b-4708-b5db-a280d7f8ad3b req-cb38bb6e-6c39-4d4c-8d17-8a5f41bd0ed7 service nova] Enqueued Resource ID: 5678b67b-44d5-4fef-98c8-c4d9b5ba51ba with Priority: HIGHEST for action port [ 905.097459] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_rules [ 905.097621] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_members [ 905.097672] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5678b67b-44d5-4fef-98c8-c4d9b5ba51ba with Priority: HIGHEST for action port [ 905.098224] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.098342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.098410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.098604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.098682] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.100643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.100839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.100839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.100982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.101141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.101393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.101393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.101480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.101511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.101652] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.102650] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.102762] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.102832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.102970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.103678] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5678b67b-44d5-4fef-98c8-c4d9b5ba51ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.217733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.218059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.218059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.218247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.218343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.218549] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.218925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.218925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.218925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.218925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.219228] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 is going to be deleted. [ 905.252295] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.252570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.252570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.252691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.252786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.252895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.253051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.253213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.253366] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.253470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.253524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.253660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.253735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.253823] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ec0ad55-b4c7-4db0-9d96-64678434dae2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.609027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.609027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.609027] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.609027] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5678b67b-44d5-4fef-98c8-c4d9b5ba51ba with status ACTIVE [ 905.609467] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.609467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.609467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.609600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.613025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.613025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.613025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.613025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5678b67b-44d5-4fef-98c8-c4d9b5ba51ba is going to be updated. [ 905.635066] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.635066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.635066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.635066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.635066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.635349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5678b67b-44d5-4fef-98c8-c4d9b5ba51ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.757120] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.757120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.757120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.757120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.757340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.757379] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.757517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.757566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.757807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.757807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.757906] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ec0ad55-b4c7-4db0-9d96-64678434dae2 already deleted. [ 905.758028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ec0ad55-b4c7-4db0-9d96-64678434dae2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.114581] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.341493] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 906.343077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.343077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.343077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.343077] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.343077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.343077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.343077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.345990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.345990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.345990] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.617822] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.618273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.618273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.618488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.618645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.618786] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f is going to be created. [ 906.644195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.644426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.644541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.644859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.645099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.655161] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: UNINITIALIZED for 2s [ 906.850854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.850854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.850854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.851265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.851325] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.851484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.851565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.851797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.851920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.852018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.852473] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.852562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.852620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.854671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.854671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.854671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.854671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.854671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.854944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.854944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.854944] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.950329] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 906.950329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.950329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.950329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.950627] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.950627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.950627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.950812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.950812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.950877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.950908] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.340503] env[64436]: INFO networking_nsxv3.common.synchronization [req-afeca0d4-b47d-4ebf-be5e-554e80f731f6 req-d9c84358-1d22-4faa-8ad5-fde565090b4b tempest-ServersWithSpecificFlavorTestJSON-1646558451 tempest-ServersWithSpecificFlavorTestJSON-1646558451-project-member] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 907.341157] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGHEST for action security_group_members [ 907.342186] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.342186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.342186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.342186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.342584] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.342584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.342584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.342706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.342782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.342862] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.359019] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a22f030d-b590-48f1-adde-d139f2aa31d4: rpc.has_security_group_logging(os_id): False [ 907.377872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.377872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.377872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.377872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.378674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.378674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.378674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.378674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.378674] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.378674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.378674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.378674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.378922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.378922] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 907.440898] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.441089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.441089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.441338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.441484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.454025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.454025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.454025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.454276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.454323] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.454980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.454980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.454980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.454980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.454980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.454980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.455319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.455319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.455319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.455420] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.455488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.455526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.455672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.455739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.455810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.455912] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.475381] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 907.845397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.845802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.845802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.845986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.866040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.866468] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.866603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.866673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.867489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.867489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.867489] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be updated. [ 907.892813] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.893060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.893111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.893342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.893520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.900976] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: IN_PROGRESS for 2s [ 907.959340] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d226089-248b-47ba-bfe1-ba9fc67ca294: rpc.has_security_group_logging(os_id): False [ 907.978195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.978584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.978715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.978974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.979208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.979455] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.979597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.979692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.979914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.980043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.980307] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.980766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.980874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.981069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.981207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.981480] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.981620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.981711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.982067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.982207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.982328] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 908.046604] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.047728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.047850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.048165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.048376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.060133] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 908.664176] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: SUCCESS [ 908.664401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.664592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.664820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.665015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.665145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.665211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.665364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.665448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.665531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.665620] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.134724] env[64436]: INFO networking_nsxv3.common.synchronization [None req-21061113-7722-4235-8497-150f333e5b02 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 909.135522] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 909.135975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.136171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.136283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.136567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.136803] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.136965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.137079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.137315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.137976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.137976] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.170527] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.510213] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 909.510435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.639888] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.673768] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a84c314-4b02-42db-a1d1-74e8ea62582f: rpc.has_security_group_logging(os_id): False [ 909.691581] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.691785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.691872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.692121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.692215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.692476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.692709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.692709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.692798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.692879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.692967] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f is going to be created. [ 909.750270] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.750631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.750807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.751022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.751274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.765466] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: IN_PROGRESS for 2s [ 909.912313] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc in Status: SUCCESS [ 909.912709] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc deletion is rescheduled due to dependency. [ 909.912923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.075365] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 910.076095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.142953] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.601309] env[64436]: INFO networking_nsxv3.common.synchronization [req-4f68f549-bcbc-453f-a158-e84f3c484094 req-e1f5991f-2dd4-446a-9489-474862766c05 tempest-ServerMetadataTestJSON-2140719091 tempest-ServerMetadataTestJSON-2140719091-project-member] Enqueued Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_members [ 910.601933] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_members [ 910.602199] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.602331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.602399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.602665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.602803] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.602936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.603013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.603124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.603210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.603303] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.610328] env[64436]: INFO networking_nsxv3.common.synchronization [None req-75115b3c-4792-46a2-8b92-432c9332780c None None] Enqueued Resource ID: 166036ed-25fe-436e-84f3-16c287570988 with Priority: HIGHEST for action port [ 910.610840] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166036ed-25fe-436e-84f3-16c287570988 with Priority: HIGHEST for action port [ 910.612137] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-166036ed-25fe-436e-84f3-16c287570988 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.612292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-166036ed-25fe-436e-84f3-16c287570988" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.612365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-166036ed-25fe-436e-84f3-16c287570988" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.612746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-166036ed-25fe-436e-84f3-16c287570988" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.612746] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('166036ed-25fe-436e-84f3-16c287570988',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.645876] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.646030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.646104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.646313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.646400] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.646497] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 910.673962] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.674130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.674130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.674337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.674484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.682308] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 911.005571] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.005571] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-188" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.005738] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-188" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.006267] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-188" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.006385] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.006546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.006666] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.006904] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.008167] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.008452] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.008583] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.008705] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.008822] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.008938] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.009075] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.009232] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.026118] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.027059] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 911.027059] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.027059] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-188" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.027059] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ff0af76c-5888-4a30-9792-1468d07472e1 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.027293] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.027329] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.027644] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.027787] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff0af76c-5888-4a30-9792-1468d07472e1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.111890] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.111890] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.111890] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d already deleted. [ 911.111890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.118374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 166036ed-25fe-436e-84f3-16c287570988 [ 911.118603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.118700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.118700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.118869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.118949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.119072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:166036ed-25fe-436e-84f3-16c287570988 already deleted. [ 911.119163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-166036ed-25fe-436e-84f3-16c287570988" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.372268] env[64436]: INFO networking_nsxv3.common.synchronization [req-f0c621ea-fbc5-467a-84be-48b6cf162c29 req-46c2469c-e3c2-4837-af84-ddc325ad7926 tempest-ServersTestJSON-230956575 tempest-ServersTestJSON-230956575-project-member] Enqueued Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_members [ 911.372812] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 with Priority: HIGHEST for action security_group_members [ 911.375800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-80355bd7-8e39-4ae8-bf46-4d775230b0d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.376897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.376897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.376897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.376897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.376897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.376897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.376897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.376897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.376897] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80355bd7-8e39-4ae8-bf46-4d775230b0d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.532267] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.532522] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.532631] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.532908] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.533083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.533246] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ff0af76c-5888-4a30-9792-1468d07472e1 not found, creating... [ 911.533515] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.533691] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.533814] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.534066] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.534218] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.534514] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.534686] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.534841] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.536858] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.537121] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.537299] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ff0af76c-5888-4a30-9792-1468d07472e1 is going to be created. [ 911.559787] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.559986] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.560132] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.560561] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.560794] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.561036] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.625760] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.625760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.625760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.625760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.625760] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.625760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.625760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.625760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.625760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.626209] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.626209] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.626209] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.626302] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.626428] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.626610] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.626781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.648281] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.648281] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 911.648281] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.648281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.648281] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b4499099-56ac-4f6b-820e-a251241696d1 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.648281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.648281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.648281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.648281] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4499099-56ac-4f6b-820e-a251241696d1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.779568] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: SUCCESS [ 911.779839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.881200] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.881200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.881200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.881200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.900802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.900802] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.900976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.901086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.901784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.901784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.901784] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 is going to be updated. [ 911.930036] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.931030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.931030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.931286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.931439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.940440] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 in Status: IN_PROGRESS for 2s [ 911.972701] env[64436]: INFO networking_nsxv3.common.synchronization [req-2c624a84-c2f7-423f-99b0-96c268fbc709 req-bc9ee57f-84a3-4f18-aa40-e2ad72422ebd tempest-ServersNegativeTestJSON-1058932887 tempest-ServersNegativeTestJSON-1058932887-project-member] Enqueued Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 911.973406] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 with Priority: HIGHEST for action security_group_members [ 911.973743] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-377c820a-e6ee-48bb-9450-abc7d40a08d0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.973865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.973933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.974256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.974460] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.974595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.974678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.974863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.974971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.975103] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('377c820a-e6ee-48bb-9450-abc7d40a08d0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.154584] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.154812] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.154949] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.155265] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.155618] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.155701] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b4499099-56ac-4f6b-820e-a251241696d1 not found, creating... [ 912.156036] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.156245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.156407] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.156615] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.156760] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.157066] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.157236] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.157360] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.157573] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.157714] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.157860] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b4499099-56ac-4f6b-820e-a251241696d1 is going to be created. [ 912.195378] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.195378] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.195378] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.195378] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.195378] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.195378] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.300070] env[64436]: INFO networking_nsxv3.common.synchronization [req-4f68f549-bcbc-453f-a158-e84f3c484094 req-1ac5c29e-646d-41fd-90bd-3afaf69bdca0 service nova] Enqueued Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_rules [ 912.300355] env[64436]: INFO networking_nsxv3.common.synchronization [req-4f68f549-bcbc-453f-a158-e84f3c484094 req-1ac5c29e-646d-41fd-90bd-3afaf69bdca0 service nova] Enqueued Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_members [ 912.300504] env[64436]: INFO networking_nsxv3.common.synchronization [req-4f68f549-bcbc-453f-a158-e84f3c484094 req-1ac5c29e-646d-41fd-90bd-3afaf69bdca0 service nova] Enqueued Resource ID: ff0af76c-5888-4a30-9792-1468d07472e1 with Priority: HIGHEST for action port [ 912.300664] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_rules [ 912.300793] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_members [ 912.300925] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff0af76c-5888-4a30-9792-1468d07472e1 with Priority: HIGHEST for action port [ 912.301455] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.301585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.301671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.301893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.301980] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.307691] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.307802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.307866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.311433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.311433] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.311433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.311433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.311433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.311433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.311433] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.312315] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff0af76c-5888-4a30-9792-1468d07472e1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.313020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.313020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.313020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.313020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff0af76c-5888-4a30-9792-1468d07472e1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.477896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.478223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.478223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.479730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.498314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.499054] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.499054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.499054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.499054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.499054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.499312] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 is going to be updated. [ 912.521443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.521674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.521674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.521974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.522122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.529524] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: IN_PROGRESS for 2s [ 912.692253] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 912.692617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.741842] env[64436]: INFO networking_nsxv3.common.synchronization [req-0f6ad30c-1bc9-4db2-bff1-10ab4a5796f3 req-0f84cee7-d578-47b3-b9fd-a717e5daf563 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 912.742372] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 912.742691] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.742854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.742920] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.743088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.743246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.743346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.743410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.743559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.743718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.743785] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.814225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.814386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.814582] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.815399] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff0af76c-5888-4a30-9792-1468d07472e1 with status ACTIVE [ 912.815573] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.815679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.815741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.815931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.816023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.818874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.818874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.818874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.818874] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff0af76c-5888-4a30-9792-1468d07472e1 is going to be updated. [ 912.839962] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.839962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.839962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.839962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.839962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.839962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff0af76c-5888-4a30-9792-1468d07472e1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.948471] env[64436]: INFO networking_nsxv3.common.synchronization [req-c9f301bd-4866-4d92-b1dc-e8291960e90e req-7950e42b-97f6-4228-954f-913bb044ca3a service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 912.948673] env[64436]: INFO networking_nsxv3.common.synchronization [req-c9f301bd-4866-4d92-b1dc-e8291960e90e req-7950e42b-97f6-4228-954f-913bb044ca3a service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 912.948812] env[64436]: INFO networking_nsxv3.common.synchronization [req-c9f301bd-4866-4d92-b1dc-e8291960e90e req-7950e42b-97f6-4228-954f-913bb044ca3a service nova] Enqueued Resource ID: b4499099-56ac-4f6b-820e-a251241696d1 with Priority: HIGHEST for action port [ 912.949477] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 912.949546] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 912.949628] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4499099-56ac-4f6b-820e-a251241696d1 with Priority: HIGHEST for action port [ 912.949900] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.952218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.952218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.952741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.952741] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.953787] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.954034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.954034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.954155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.954316] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.954593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.954593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.954683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.954683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.954782] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.955724] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4499099-56ac-4f6b-820e-a251241696d1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.955724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.955724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.956401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.956401] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4499099-56ac-4f6b-820e-a251241696d1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.029021] env[64436]: INFO networking_nsxv3.common.synchronization [None req-97e56cd0-3de3-418b-8fd3-62460f3a7cd1 None None] Enqueued Resource ID: 9b19e5ea-7eb5-45db-b439-22a33dc6df51 with Priority: HIGHEST for action port [ 913.029333] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b19e5ea-7eb5-45db-b439-22a33dc6df51 with Priority: HIGHEST for action port [ 913.029879] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b19e5ea-7eb5-45db-b439-22a33dc6df51 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.030054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b19e5ea-7eb5-45db-b439-22a33dc6df51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.030183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b19e5ea-7eb5-45db-b439-22a33dc6df51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.030459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b19e5ea-7eb5-45db-b439-22a33dc6df51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.030543] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b19e5ea-7eb5-45db-b439-22a33dc6df51',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.247084] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.247084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.247084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.247283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.247322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.248088] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.248088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.248088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.248088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.248088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.248088] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 913.273732] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.273879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.273879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.275563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.275563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.282723] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 913.321409] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.458698] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.458698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.458698] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.459851] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4499099-56ac-4f6b-820e-a251241696d1 with status ACTIVE [ 913.460098] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.460330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.460473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.462016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.462016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.462016] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.462016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.462016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.462016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.462016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.462322] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.462322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.462405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.463356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.463356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.463356] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4499099-56ac-4f6b-820e-a251241696d1 is going to be updated. [ 913.483256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.483621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.483621] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.483724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.483826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.483988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4499099-56ac-4f6b-820e-a251241696d1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.532394] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b19e5ea-7eb5-45db-b439-22a33dc6df51 [ 913.533030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.533030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.533030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.533030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.533281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.533281] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b19e5ea-7eb5-45db-b439-22a33dc6df51 already deleted. [ 913.533360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b19e5ea-7eb5-45db-b439-22a33dc6df51" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.824061] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.824399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.825142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.825763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.825763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.825763] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d is going to be created. [ 913.849256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.849437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.849539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.849746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.849907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.861749] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d in Status: UNINITIALIZED for 2s [ 913.949268] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 in Status: SUCCESS [ 913.949455] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80355bd7-8e39-4ae8-bf46-4d775230b0d4 deletion is rescheduled due to dependency. [ 913.949571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80355bd7-8e39-4ae8-bf46-4d775230b0d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.965066] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.468361] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.468546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.468589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.468810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.468898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.469009] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 914.495098] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.495098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.495098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.495098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.495098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.503088] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 914.538399] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 in Status: SUCCESS [ 914.538578] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 377c820a-e6ee-48bb-9450-abc7d40a08d0 deletion is rescheduled due to dependency. [ 914.538618] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-377c820a-e6ee-48bb-9450-abc7d40a08d0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.204746] env[64436]: INFO networking_nsxv3.common.synchronization [req-43c5b2ee-dc56-4d2b-9830-526e71e5d13a req-93d95349-d844-4d47-bbfc-7b97a150b044 tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 915.205326] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 915.205626] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.205790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.205895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.206177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.206339] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.206439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.206499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.206683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.206786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.206826] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.291613] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 915.291790] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 915.291902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.503909] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.504289] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.504289] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.504590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.504868] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.505046] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.505175] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.505425] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.505581] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.505883] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.506043] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.506156] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.506297] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.506428] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.506544] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.506696] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.523652] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.523830] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 915.523973] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.524191] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.524529] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.524712] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.524838] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.525219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.525368] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6bb360-4c5f-4be9-97ea-d80513dc0ea4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.708914] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.709222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.709362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.709600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.709742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.710039] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.710193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.710253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.710458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.710560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.710675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e already deleted. [ 915.710983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.872478] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d in Status: SUCCESS [ 915.872576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.872744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.872967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.873170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.873360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.873360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.873498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.873578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.873663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.873752] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.028986] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.029242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.029371] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.029653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.029812] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.029970] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 not found, creating... [ 916.030312] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.030491] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.030616] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.030845] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.030992] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.031428] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.031602] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.031726] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.031937] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.032095] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.032244] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 is going to be created. [ 916.050073] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.050313] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.051921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.051921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.051921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.051921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.379304] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.379304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.379304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.380313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.380313] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.380313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.380313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.380313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.380313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.380517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.380899] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.380899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.380899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.381052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.381178] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.381247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.381317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.381462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.381554] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.381654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.381753] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.513677] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 916.514068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.514137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.514303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.514491] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.514610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.514672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.514823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.514897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.514980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.515082] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.883681] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbe8273e-23a4-44f7-a432-9d347c32cd2d: rpc.has_security_group_logging(os_id): False [ 916.901049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.901248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.901327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.901678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.901798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.902051] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.902155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.902223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.902377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.902456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.902643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.902736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.902854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.902930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.903103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.903285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.903379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.903430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.903571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.903644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.903730] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d is going to be created. [ 916.955073] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.955293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.955415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.955609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.955795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.965499] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d in Status: IN_PROGRESS for 2s [ 917.018170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.018341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.018409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.018604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.018776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.018917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.018981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.019130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.019223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.019315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.019452] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.019547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.019635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.019860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.019860] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.019983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.020148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.020219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.020290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.020366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.020501] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.263550] env[64436]: INFO networking_nsxv3.common.synchronization [req-43c5b2ee-dc56-4d2b-9830-526e71e5d13a req-d47c88a7-f3a7-494a-9333-f6cda1bd8aae service nova] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 917.263742] env[64436]: INFO networking_nsxv3.common.synchronization [req-43c5b2ee-dc56-4d2b-9830-526e71e5d13a req-d47c88a7-f3a7-494a-9333-f6cda1bd8aae service nova] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 917.263900] env[64436]: INFO networking_nsxv3.common.synchronization [req-43c5b2ee-dc56-4d2b-9830-526e71e5d13a req-d47c88a7-f3a7-494a-9333-f6cda1bd8aae service nova] Enqueued Resource ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 with Priority: HIGHEST for action port [ 917.264178] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 917.264899] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 917.264899] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 with Priority: HIGHEST for action port [ 917.265085] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.265234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.265234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.265385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.265481] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.266341] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.266474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.266531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.266789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.266859] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.266974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.266974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.267197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.267310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.267459] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.268227] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.268397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.268397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.268638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.268638] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6bb360-4c5f-4be9-97ea-d80513dc0ea4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.523775] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d226089-248b-47ba-bfe1-ba9fc67ca294: rpc.has_security_group_logging(os_id): False [ 917.553178] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.553178] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.553178] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.553178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.554031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.554566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.554783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.555479] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.555748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.555943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.556252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.556467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.556708] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 917.650393] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.650534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.650631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.650806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.650951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.666740] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 917.770985] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.771090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.771494] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.772144] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 with status ACTIVE [ 917.772348] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.772472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.772541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.772741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.772840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.773073] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.773258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.773258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.773865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.773865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.773865] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.773865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.773865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.774164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.774164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.774164] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 is going to be updated. [ 917.802370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.802513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.802573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.802799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.802933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.803104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.276651] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.781118] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.781636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.781636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.781853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.781853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.782047] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e is going to be created. [ 918.811821] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.811977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.812053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.812262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.812420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.821916] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: UNINITIALIZED for 2s [ 918.978990] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d in Status: SUCCESS [ 918.979226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.679217] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 919.679503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.821119] env[64436]: INFO networking_nsxv3.common.synchronization [req-9154b5f6-af45-4acd-a710-b64b812b3d29 req-c3902edc-e7a3-4e4a-8152-40f83a1a1b9f tempest-FloatingIPsAssociationNegativeTestJSON-1243202929 tempest-FloatingIPsAssociationNegativeTestJSON-1243202929-project-member] Enqueued Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_members [ 919.821710] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_members [ 919.822028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.822157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.822223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.822618] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.822618] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.822738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.822773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.822921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.823013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.823307] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.319812] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.320125] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-550" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.320391] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-550" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.320726] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-550" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.321084] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.321358] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.321605] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.322123] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.322123] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.322379] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.322553] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.322713] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.322869] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.323071] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.323234] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.323420] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.325759] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.325894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.325992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.326260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.326409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.326635] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.326782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.326869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.327070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.327249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.327366] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 already deleted. [ 920.327474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.345911] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.346274] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.346274] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.346634] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-550" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.346969] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d9947185-f137-4b26-90f1-becfc17c3be7 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.347189] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.347415] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.347631] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.347769] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9947185-f137-4b26-90f1-becfc17c3be7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.831224] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: SUCCESS [ 920.831929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.832142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.832559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.832759] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.832878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.835903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.835903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.835903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.835903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.835903] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.851337] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.851616] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.851768] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.852113] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.852349] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.852523] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d9947185-f137-4b26-90f1-becfc17c3be7 not found, creating... [ 920.853554] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.853772] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.854617] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.854617] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.854965] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.854965] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.855147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.855330] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.855692] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.855692] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.855823] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d9947185-f137-4b26-90f1-becfc17c3be7 is going to be created. [ 920.880511] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.880739] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.880835] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.881371] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.881371] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.881628] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.046455] env[64436]: INFO networking_nsxv3.common.synchronization [None req-08633b96-e620-4a41-9073-7b66e8ae8625 None None] Enqueued Resource ID: 1b849b17-2907-4379-8ae1-7a46e6fa8f59 with Priority: HIGHEST for action port [ 921.047078] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b849b17-2907-4379-8ae1-7a46e6fa8f59 with Priority: HIGHEST for action port [ 921.047415] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b849b17-2907-4379-8ae1-7a46e6fa8f59 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.047534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b849b17-2907-4379-8ae1-7a46e6fa8f59" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.047599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b849b17-2907-4379-8ae1-7a46e6fa8f59" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.047845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b849b17-2907-4379-8ae1-7a46e6fa8f59" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.047923] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b849b17-2907-4379-8ae1-7a46e6fa8f59',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.337575] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.551205] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b849b17-2907-4379-8ae1-7a46e6fa8f59 [ 921.551320] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.551405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.551479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.551680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.554981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.554981] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b849b17-2907-4379-8ae1-7a46e6fa8f59 already deleted. [ 921.554981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b849b17-2907-4379-8ae1-7a46e6fa8f59" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.799449] env[64436]: INFO networking_nsxv3.common.synchronization [req-9154b5f6-af45-4acd-a710-b64b812b3d29 req-ab3feb63-968a-4dd1-aaed-0711683b4f31 service nova] Enqueued Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_rules [ 921.799643] env[64436]: INFO networking_nsxv3.common.synchronization [req-9154b5f6-af45-4acd-a710-b64b812b3d29 req-ab3feb63-968a-4dd1-aaed-0711683b4f31 service nova] Enqueued Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_members [ 921.799772] env[64436]: INFO networking_nsxv3.common.synchronization [req-9154b5f6-af45-4acd-a710-b64b812b3d29 req-ab3feb63-968a-4dd1-aaed-0711683b4f31 service nova] Enqueued Resource ID: d9947185-f137-4b26-90f1-becfc17c3be7 with Priority: HIGHEST for action port [ 921.800623] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_rules [ 921.800759] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_members [ 921.800850] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9947185-f137-4b26-90f1-becfc17c3be7 with Priority: HIGHEST for action port [ 921.801238] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.801372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.801441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.801710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.801793] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.803465] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.803598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.803651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.803817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.804636] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.804636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.804636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.804636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.804636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.804636] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.805213] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9947185-f137-4b26-90f1-becfc17c3be7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.805356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.805402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.805529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.805597] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9947185-f137-4b26-90f1-becfc17c3be7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.839108] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e: rpc.has_security_group_logging(os_id): False [ 921.859643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.859819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.859870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.860056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.860183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.860434] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.860756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.860756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.860756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.860879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.860917] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e is going to be created. [ 921.932338] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.932515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.932589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.932801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.932988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.944560] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: IN_PROGRESS for 2s [ 922.306855] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.308703] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.308703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.308703] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9947185-f137-4b26-90f1-becfc17c3be7 with status ACTIVE [ 922.308703] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.308703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.309092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.309092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.309092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.309289] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.309365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.309438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.309792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.309792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.309925] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.309925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.310386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.310386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.310386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.310386] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9947185-f137-4b26-90f1-becfc17c3be7 is going to be updated. [ 922.334956] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.335188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.335269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.335499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.335770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.335855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9947185-f137-4b26-90f1-becfc17c3be7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.809663] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.312122] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.312455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.312499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.312735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.312826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.312929] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 is going to be created. [ 923.338023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.338023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.338023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.338023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.338023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.346114] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 in Status: UNINITIALIZED for 2s [ 923.637100] env[64436]: INFO networking_nsxv3.common.synchronization [None req-cf506961-cee1-452b-9753-195c95e578b7 None None] Enqueued Resource ID: 1035d3ed-745b-472d-9e26-3b150009951a with Priority: HIGHEST for action port [ 923.637660] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1035d3ed-745b-472d-9e26-3b150009951a with Priority: HIGHEST for action port [ 923.637970] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-1035d3ed-745b-472d-9e26-3b150009951a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.639380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1035d3ed-745b-472d-9e26-3b150009951a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.639380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1035d3ed-745b-472d-9e26-3b150009951a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.639380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1035d3ed-745b-472d-9e26-3b150009951a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.639380] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1035d3ed-745b-472d-9e26-3b150009951a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.961300] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: SUCCESS [ 923.961658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.141890] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1035d3ed-745b-472d-9e26-3b150009951a [ 924.143416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.143416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.143593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.143692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.143794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.143899] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1035d3ed-745b-472d-9e26-3b150009951a already deleted. [ 924.144091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1035d3ed-745b-472d-9e26-3b150009951a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.338031] env[64436]: INFO networking_nsxv3.common.synchronization [req-5fa27c2d-4858-48be-8887-7ec4f12ae161 req-03edbcb6-a88f-4631-83f7-2d7c0bdd02bd tempest-ServerMetadataTestJSON-2140719091 tempest-ServerMetadataTestJSON-2140719091-project-member] Enqueued Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_members [ 925.338575] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGHEST for action security_group_members [ 925.338882] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.339018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.339086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.339327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.339479] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.339608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.340207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.340207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.340207] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.340207] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.356086] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 in Status: SUCCESS [ 925.356302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.356476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.356685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.356861] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.356993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.358023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.358023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.358023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.358023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.358023] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.842549] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.842768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.842768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.842998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.843125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.843336] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.843440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.843505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.843697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.843777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.843866] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d is going to be updated. [ 925.861288] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.861499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.861561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.861732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.861897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.861996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.862073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.862226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.862309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.862407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.862533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.862624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.862683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.862822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.862955] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.863058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.863119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.863256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.863330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.863436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.863520] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.867527] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.867527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.867527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.867527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.867527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.876121] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d in Status: IN_PROGRESS for 2s [ 926.231704] env[64436]: INFO networking_nsxv3.common.synchronization [req-f7bd8df5-cd6e-4681-b5b3-d6ef55c7245a req-e85ae98e-d54a-48b1-af48-9c537722ca40 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 926.232485] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 926.232803] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.232946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.233085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.233330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.233863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.234060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.234175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.234406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.234507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.234605] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.365530] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad80987d-a16f-49ad-a3ce-836e3cca1187: rpc.has_security_group_logging(os_id): False [ 926.387024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.387024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.387024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.387024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.387705] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.387705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.387705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.387705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.387705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.387705] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 is going to be created. [ 926.504773] env[64436]: INFO networking_nsxv3.common.synchronization [req-91f84d99-5dba-4926-9d5c-37bbe7711699 req-18308304-d3b6-4191-9472-6ad197be3784 tempest-ImagesTestJSON-552179481 tempest-ImagesTestJSON-552179481-project-member] Enqueued Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 926.505317] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22f030d-b590-48f1-adde-d139f2aa31d4 with Priority: HIGHEST for action security_group_members [ 926.505628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-a22f030d-b590-48f1-adde-d139f2aa31d4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.505753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.505836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.507155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.507365] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.507478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.507546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.507720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.507808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.507901] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a22f030d-b590-48f1-adde-d139f2aa31d4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.512326] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.512455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.512525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.512713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.512901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.525853] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 in Status: IN_PROGRESS for 2s [ 926.737696] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.014975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.014975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.014975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.014975] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 is going to be updated. [ 927.039814] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.039945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.040032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.040307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.040459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.049675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: IN_PROGRESS for 2s [ 927.080917] env[64436]: INFO networking_nsxv3.common.synchronization [req-c7e97574-d932-44f3-ab3f-173192133ce8 req-c14fdccb-c489-47b8-bf44-f37c6c8d3d99 tempest-InstanceActionsTestJSON-1091002950 tempest-InstanceActionsTestJSON-1091002950-project-member] Enqueued Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_members [ 927.081393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_members [ 927.081697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.081817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.081886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.082146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.082304] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.082408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.082469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.082655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.082692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.082785] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.241406] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.430036] env[64436]: INFO networking_nsxv3.common.synchronization [None req-49822ad4-e366-4c5f-a007-6eeddaa54539 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 927.430036] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 927.430709] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.430974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.509113] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.509472] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-895" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.509751] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-895" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.510016] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-895" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.510365] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.510549] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.510683] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.510927] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.511169] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.512023] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.512023] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.512023] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.512023] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.512282] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.512282] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.512363] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.534206] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.534388] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.534526] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.534705] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-895" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.535038] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.535218] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.535348] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.535654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.535919] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc24223-bb5b-47ac-a924-c4fcc8ea0b46',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.589087] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.589358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.589486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.589816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.589990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.590313] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.590492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.590616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.590908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.591074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.591232] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b17ff089-f7e6-45c6-8675-a0bacc25487d already deleted. [ 927.591378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.743032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.743228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.743305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.743541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.743636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.743752] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 927.777302] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.777302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.777638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.777695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.777880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.790369] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 927.886277] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d in Status: SUCCESS [ 927.886589] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d deletion is rescheduled due to dependency. [ 927.886769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.039240] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.040076] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.041390] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.041390] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.041390] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.041390] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 not found, creating... [ 928.041390] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.041390] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.041719] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.041843] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.042408] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.043570] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.043897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.044080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.044361] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.045092] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.046329] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 is going to be created. [ 928.064466] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.064696] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.065446] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.065808] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.066106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.066390] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.537726] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 in Status: SUCCESS [ 928.538035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.844855] env[64436]: INFO networking_nsxv3.common.synchronization [req-c7e97574-d932-44f3-ab3f-173192133ce8 req-2b4b11a1-b634-4b5b-ae97-483f76ea4cca service nova] Enqueued Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_rules [ 928.845086] env[64436]: INFO networking_nsxv3.common.synchronization [req-c7e97574-d932-44f3-ab3f-173192133ce8 req-2b4b11a1-b634-4b5b-ae97-483f76ea4cca service nova] Enqueued Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_members [ 928.845269] env[64436]: INFO networking_nsxv3.common.synchronization [req-c7e97574-d932-44f3-ab3f-173192133ce8 req-2b4b11a1-b634-4b5b-ae97-483f76ea4cca service nova] Enqueued Resource ID: 7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 with Priority: HIGHEST for action port [ 928.845519] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_rules [ 928.845653] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_members [ 928.845760] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 with Priority: HIGHEST for action port [ 928.846571] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.846705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.846776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.847084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.847188] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.848113] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.848241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.848322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.848509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.848662] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.848756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.848820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.848985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.849085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.849206] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.851262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.851408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.851440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.851600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.851673] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc24223-bb5b-47ac-a924-c4fcc8ea0b46',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.058535] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a22f030d-b590-48f1-adde-d139f2aa31d4 in Status: SUCCESS [ 929.058645] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a22f030d-b590-48f1-adde-d139f2aa31d4 deletion is rescheduled due to dependency. [ 929.058690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a22f030d-b590-48f1-adde-d139f2aa31d4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.353544] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.354582] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.354706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.354872] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 with status ACTIVE [ 929.355045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.355154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.355215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.355418] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.355507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.355702] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.355782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.355833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.355995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.356086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.356267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.356361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.356477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.356558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.356632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.356857] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bc24223-bb5b-47ac-a924-c4fcc8ea0b46 is going to be updated. [ 929.376793] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.376927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.377009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.377217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.378156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.378156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bc24223-bb5b-47ac-a924-c4fcc8ea0b46" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.799746] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 929.800111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.800111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.800330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.800512] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.800625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.800689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.800829] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.800906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.800999] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.859714] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.303416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.303604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.303726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.304036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.304148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.304348] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.304485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.304574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.304738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.304818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.304908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 930.332342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.332494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.332575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.332783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.332927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.342468] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 930.362154] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.362338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.362395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.362598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.362691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.362793] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b17ff089-f7e6-45c6-8675-a0bacc25487d is going to be created. [ 930.384836] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.384836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.384942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.385666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.385871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.394981] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b17ff089-f7e6-45c6-8675-a0bacc25487d in Status: UNINITIALIZED for 2s [ 930.593938] env[64436]: INFO networking_nsxv3.common.synchronization [req-3fd45a43-a3a7-4f3d-b3a7-16ad76640e1c req-3f56f9aa-414b-410d-9f0f-bd4c07a4b865 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_members [ 930.594476] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGHEST for action security_group_members [ 930.594788] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.594911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.594982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.595347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.595506] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.595667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.595667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.595831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.595939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.596047] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.098516] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.099376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.099376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.099376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.120301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.120583] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.120795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.120795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.120974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.121075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.121167] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 439934dd-a8d0-443b-bef1-613de792a394 is going to be updated. [ 931.147999] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.148171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.148240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.148446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.148578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.156014] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 439934dd-a8d0-443b-bef1-613de792a394 in Status: IN_PROGRESS for 2s [ 932.358014] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 932.358014] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 deletion is rescheduled due to dependency. [ 932.358014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.404666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b17ff089-f7e6-45c6-8675-a0bacc25487d in Status: SUCCESS [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.404666] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.404666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.404666] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.910815] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.911039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.911116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.911342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.911511] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.911649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.911707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.911851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.911938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.912038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.912188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.912276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.912335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.912470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.912614] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.912717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.912759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.912886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.912959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.913045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.913131] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.165985] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 439934dd-a8d0-443b-bef1-613de792a394 in Status: SUCCESS [ 933.165985] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 439934dd-a8d0-443b-bef1-613de792a394 deletion is rescheduled due to dependency. [ 933.165985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.420970] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b17ff089-f7e6-45c6-8675-a0bacc25487d: rpc.has_security_group_logging(os_id): False [ 933.438145] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.438145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.438145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.438145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.438145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.438145] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.438145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.438145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.440019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.440019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.440019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.441961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.441961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.441961] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b17ff089-f7e6-45c6-8675-a0bacc25487d is going to be created. [ 933.494906] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.494906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.494906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.495064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.495217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.505815] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b17ff089-f7e6-45c6-8675-a0bacc25487d in Status: IN_PROGRESS for 2s [ 933.592799] env[64436]: INFO networking_nsxv3.common.synchronization [req-6e3ac322-b6aa-449b-b315-3dead67544c9 req-4bb46345-7021-45c1-9d93-196442b0202b tempest-ServerTagsTestJSON-113838391 tempest-ServerTagsTestJSON-113838391-project-member] Enqueued Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_members [ 933.593817] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_members [ 933.593817] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.593817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.593817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.594150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.594331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.594437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.594496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.594661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.594749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.594839] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.096671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.096848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.096922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.097175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.097297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.097465] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.097568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.097632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.097797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.097874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.097959] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e966668a-f00a-41f7-a7f9-623456edad39 already deleted. [ 934.098081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.329871] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.331116] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.331116] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.331116] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.335024] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.335024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.335024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.335024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.335024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.335024] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.335024] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.335024] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.335024] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.335024] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.335024] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.335024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.353527] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.353753] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.353911] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.354050] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-831" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.354494] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-71b13771-4ca2-4941-9e2c-28060b72b594 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.354778] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.354778] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.355116] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.355353] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b13771-4ca2-4941-9e2c-28060b72b594',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.858381] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.858706] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.861867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.861867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.861867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.861867] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 71b13771-4ca2-4941-9e2c-28060b72b594 not found, creating... [ 934.861867] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.861867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.861867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.861867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.861867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.861867] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.862376] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.862376] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.862376] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.863562] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.863562] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 71b13771-4ca2-4941-9e2c-28060b72b594 is going to be created. [ 934.884434] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.884434] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.884879] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.884879] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.886158] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.886158] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.519954] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b17ff089-f7e6-45c6-8675-a0bacc25487d in Status: SUCCESS [ 935.520268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.597143] env[64436]: INFO networking_nsxv3.common.synchronization [req-6e3ac322-b6aa-449b-b315-3dead67544c9 req-145a8304-f63e-4904-a4b1-7ac83ed3bdc2 service nova] Enqueued Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_rules [ 935.597143] env[64436]: INFO networking_nsxv3.common.synchronization [req-6e3ac322-b6aa-449b-b315-3dead67544c9 req-145a8304-f63e-4904-a4b1-7ac83ed3bdc2 service nova] Enqueued Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_members [ 935.597143] env[64436]: INFO networking_nsxv3.common.synchronization [req-6e3ac322-b6aa-449b-b315-3dead67544c9 req-145a8304-f63e-4904-a4b1-7ac83ed3bdc2 service nova] Enqueued Resource ID: 71b13771-4ca2-4941-9e2c-28060b72b594 with Priority: HIGHEST for action port [ 935.597143] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_rules [ 935.597143] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_members [ 935.597143] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b13771-4ca2-4941-9e2c-28060b72b594 with Priority: HIGHEST for action port [ 935.597532] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.601185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.601396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.601624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.602164] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.604052] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.604247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.604359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.604552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.604750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.604895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.604932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.605122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.605217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.606060] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.606896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b13771-4ca2-4941-9e2c-28060b72b594 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.607484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.607623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.607807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.607909] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b13771-4ca2-4941-9e2c-28060b72b594',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.109705] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.109705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.110222] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.110970] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71b13771-4ca2-4941-9e2c-28060b72b594 with status ACTIVE [ 936.111564] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.111564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.111564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.111846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.111911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.115083] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.115083] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.115083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.115083] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71b13771-4ca2-4941-9e2c-28060b72b594 is going to be updated. [ 936.135299] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.135299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.135299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.135299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.135299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.135299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b13771-4ca2-4941-9e2c-28060b72b594" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.618453] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.119674] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.120148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.120148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.120148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.120417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.120417] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e966668a-f00a-41f7-a7f9-623456edad39 is going to be created. [ 937.145755] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.146065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.146065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.147195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.147525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.157045] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e966668a-f00a-41f7-a7f9-623456edad39 in Status: UNINITIALIZED for 2s [ 937.416124] env[64436]: INFO networking_nsxv3.common.synchronization [req-c14af4e1-ccc7-4e38-a447-d25ae170d162 req-68de39ce-7411-4691-9870-76cd2cf4a8a6 tempest-FloatingIPsAssociationNegativeTestJSON-1243202929 tempest-FloatingIPsAssociationNegativeTestJSON-1243202929-project-member] Enqueued Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_members [ 937.416670] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGHEST for action security_group_members [ 937.416973] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.417109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.417177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.417407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.417568] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.417671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.417734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.418170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.418170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.418170] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.921104] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.921104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.921104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.921397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.921431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.921656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.922032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.922217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.922385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.922466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.922584] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 is going to be updated. [ 937.950696] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.950696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.950696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.950696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.950696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.957203] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 in Status: IN_PROGRESS for 2s [ 939.166346] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e966668a-f00a-41f7-a7f9-623456edad39 in Status: SUCCESS [ 939.166604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.166604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.166851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.167009] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.167135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.167222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.167422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.167508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.167606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.167698] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.320441] env[64436]: INFO networking_nsxv3.common.synchronization [req-1c65ebb9-9e1e-47ba-8f15-8c728dc24996 req-7fe64dab-a6b3-45b7-8ece-fcfc3c9e8626 tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 939.320971] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 939.321289] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.321415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.321487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.321711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.321868] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.321968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.322164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.322344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.322438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.322532] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.670588] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.670841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.670936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.671180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.671782] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.671782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.671782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.672092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.672092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.672092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.672292] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.672385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.672451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.672603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.672792] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.672904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.672973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.673162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.673248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.673328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.673456] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.825277] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.825277] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.825277] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.825277] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.825496] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.825571] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.826479] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.826479] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.826479] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.826479] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.826757] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.827166] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.827166] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.827166] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.827357] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.828329] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.828986] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.829126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.829172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.829591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.829591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.829709] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.829769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.829904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.830021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.830085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.831026] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 939.848619] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.849281] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.849281] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.849281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.849660] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.849982] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.850201] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.850596] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.850778] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6ce416-c3c3-4fc0-8de3-b932328d9a1e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.863262] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.863491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.863619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.864074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.864246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.874716] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 939.969880] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 in Status: SUCCESS [ 939.969880] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 deletion is rescheduled due to dependency. [ 939.970143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.175970] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e966668a-f00a-41f7-a7f9-623456edad39: rpc.has_security_group_logging(os_id): False [ 940.209189] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.209350] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.209464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.209648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.209743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.209959] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.210070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.210143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.210281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.210350] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.210531] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.210979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.210979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.210979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.210979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.211142] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.211204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.211243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.211365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.211447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.211536] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e966668a-f00a-41f7-a7f9-623456edad39 is going to be created. [ 940.314020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.314020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.314020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.314020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.314283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.328537] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e966668a-f00a-41f7-a7f9-623456edad39 in Status: IN_PROGRESS for 2s [ 940.353662] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.353878] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.354016] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.354311] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.354474] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.354737] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ac6ce416-c3c3-4fc0-8de3-b932328d9a1e not found, creating... [ 940.355030] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.355211] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.355335] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.355567] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.355708] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.355988] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.356166] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.356301] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.356515] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.356657] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.356800] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ac6ce416-c3c3-4fc0-8de3-b932328d9a1e is going to be created. [ 940.379547] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.379752] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.379863] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.380113] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.380367] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.380600] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.077702] env[64436]: INFO networking_nsxv3.common.synchronization [req-1c65ebb9-9e1e-47ba-8f15-8c728dc24996 req-03ed1fa7-6aba-45b0-b836-a30341f44fb1 service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 941.077879] env[64436]: INFO networking_nsxv3.common.synchronization [req-1c65ebb9-9e1e-47ba-8f15-8c728dc24996 req-03ed1fa7-6aba-45b0-b836-a30341f44fb1 service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 941.078044] env[64436]: INFO networking_nsxv3.common.synchronization [req-1c65ebb9-9e1e-47ba-8f15-8c728dc24996 req-03ed1fa7-6aba-45b0-b836-a30341f44fb1 service nova] Enqueued Resource ID: ac6ce416-c3c3-4fc0-8de3-b932328d9a1e with Priority: HIGHEST for action port [ 941.078285] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 941.078417] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 941.078516] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6ce416-c3c3-4fc0-8de3-b932328d9a1e with Priority: HIGHEST for action port [ 941.079533] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.079652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.079704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.079908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.079993] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.080821] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.080906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.081225] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.081369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.081405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.081567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.081645] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6ce416-c3c3-4fc0-8de3-b932328d9a1e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.583928] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.583928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.583928] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac6ce416-c3c3-4fc0-8de3-b932328d9a1e with status ACTIVE [ 941.583928] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.583928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.583928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.584499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.584499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.585065] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.585065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.585065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.585065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.585392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.585663] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.585740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.586461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.586461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.586461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.586461] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac6ce416-c3c3-4fc0-8de3-b932328d9a1e is going to be updated. [ 941.605149] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.605291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.605352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.605551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.605682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.605842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac6ce416-c3c3-4fc0-8de3-b932328d9a1e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.697717] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-c4b5937a-0615-43f5-8dcf-c0432e3a58e9 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 941.698663] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 941.698753] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.698834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.698906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.700778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.700945] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.701072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.701140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.701308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.701398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.701493] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.883921] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 941.884179] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a deletion is rescheduled due to dependency. [ 941.884247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.884380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.884609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.884796] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.884912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.884978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.885149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.885233] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.885327] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.971246] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-517e5095-7fba-4291-8dd2-35a6fd5ad0e3 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 941.971668] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 941.971921] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.972083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.205493] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.205732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.205814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.206041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.206136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.206340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.206440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.206508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.206653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.206728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.206811] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e already deleted. [ 942.206947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.207066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.207215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.207374] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.207468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.207526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.207660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.207733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.207822] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.340685] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e966668a-f00a-41f7-a7f9-623456edad39 in Status: SUCCESS [ 942.340911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.352084] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-e9e7783c-1863-49e5-9b34-4de9cd483903 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 942.352343] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 942.353049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.353049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.387866] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.620961] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.621297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.621297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.621637] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.621904] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.622078] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.622201] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.622417] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.622565] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.622771] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.622887] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.623009] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.623124] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.623235] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.623343] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.623476] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.640653] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.640797] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.640943] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.641154] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.641574] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-36aceaa4-bb5f-4856-9254-ab787c9cd249 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.641848] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.641988] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.642330] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.642471] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36aceaa4-bb5f-4856-9254-ab787c9cd249',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.710600] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.710827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.710938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.711270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.711408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.711672] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.711777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.711831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.711977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.712070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.712175] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e already deleted. [ 942.712247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.712430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.713060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.713060] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.713060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.713060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.713060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.713349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.713349] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.890730] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.144629] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.144925] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.145085] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.145404] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.145590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.145819] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 36aceaa4-bb5f-4856-9254-ab787c9cd249 not found, creating... [ 943.146601] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.146799] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.146953] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.147281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.147475] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.147823] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.148019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.148200] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.148487] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.148650] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.148822] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 36aceaa4-bb5f-4856-9254-ab787c9cd249 is going to be created. [ 943.167848] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.168270] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.168436] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.168776] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.169047] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.169402] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.216121] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.216300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.216375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.216632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.216729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.216937] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.217051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.217116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.217294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.217369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.217447] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e already deleted. [ 943.217528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.393058] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.393219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.393275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.393492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.393586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.393702] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 943.418764] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.418902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.419032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.419222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.419370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.426903] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 944.146985] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-a605241a-a5d9-402c-80f4-626bbaef3107 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 944.147362] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-a605241a-a5d9-402c-80f4-626bbaef3107 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 944.147362] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-a605241a-a5d9-402c-80f4-626bbaef3107 service nova] Enqueued Resource ID: 36aceaa4-bb5f-4856-9254-ab787c9cd249 with Priority: HIGHEST for action port [ 944.147449] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 944.147590] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 944.147738] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36aceaa4-bb5f-4856-9254-ab787c9cd249 with Priority: HIGHEST for action port [ 944.148913] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.148913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.149215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.149534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.149648] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.150746] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.150893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.150983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.151323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.151566] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.151765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.151902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.152179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.152499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.152903] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.156527] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-36aceaa4-bb5f-4856-9254-ab787c9cd249 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.156664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.156713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.156944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.157063] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36aceaa4-bb5f-4856-9254-ab787c9cd249',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.474877] env[64436]: INFO networking_nsxv3.common.synchronization [req-47f1b962-15d3-4d96-b655-bb247243ec44 req-5a7292c1-3eba-4a6e-a7d1-fc1fcf3a59b0 tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_members [ 944.475039] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 with Priority: HIGHEST for action security_group_members [ 944.476871] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b20bfe1-a213-442b-9906-0002d7f3fe25 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.477011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.477078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.477304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.477480] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.477587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.477663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.478668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.478815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.478931] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b20bfe1-a213-442b-9906-0002d7f3fe25',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.663071] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.663071] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.663071] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36aceaa4-bb5f-4856-9254-ab787c9cd249 with status ACTIVE [ 944.663071] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.663071] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.663071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.664155] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.664462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.664666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.664935] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.666817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.666817] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36aceaa4-bb5f-4856-9254-ab787c9cd249 is going to be updated. [ 944.691584] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.691584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.691584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.691584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.691584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.691584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36aceaa4-bb5f-4856-9254-ab787c9cd249" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.981618] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.981927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.981981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.982226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.994881] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-553 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.995205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-553" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.995205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-553" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.995547] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-553" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.995805] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.996034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.996116] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.996339] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.996460] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.996667] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.996787] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.996899] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.997396] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.997396] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.997396] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.997581] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.007561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.007776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.007889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.007956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.008147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.008230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.008321] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 is going to be updated. [ 945.014597] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.014597] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.014729] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.014876] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-553" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.015191] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d077af89-90c4-40b0-83b4-5695db24983a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.015366] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.015490] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.015803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.015949] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d077af89-90c4-40b0-83b4-5695db24983a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.032308] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.032592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.032708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.032947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.033129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.040881] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 in Status: IN_PROGRESS for 2s [ 945.168348] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.173247] env[64436]: INFO networking_nsxv3.common.synchronization [req-cea1a3e2-0b89-4c4c-ab97-02b2b39f375c req-ad3d6815-7cff-4dbe-a817-d9448bf82d77 tempest-InstanceActionsTestJSON-1091002950 tempest-InstanceActionsTestJSON-1091002950-project-member] Enqueued Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_members [ 945.173247] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGHEST for action security_group_members [ 945.173247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.173247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.173247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.173247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.173247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.173247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.173984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.174293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.174565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.174883] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.439825] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.439825] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.439825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.439825] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.519084] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.519531] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.519731] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.520048] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.520218] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.520412] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d077af89-90c4-40b0-83b4-5695db24983a not found, creating... [ 945.520713] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.520886] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.521017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.521265] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.521415] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.521832] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.522011] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.522216] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.522440] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.522587] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.522735] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d077af89-90c4-40b0-83b4-5695db24983a is going to be created. [ 945.543017] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.543017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.543017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.543017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.543017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.543017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.670499] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.670737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.670818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.671065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.671165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.671372] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be created. [ 945.678228] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.678351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.678421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.678613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.678706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.679058] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.679058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.679182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.679271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.679362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.679493] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b17ff089-f7e6-45c6-8675-a0bacc25487d is going to be updated. [ 945.705458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.705599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.705657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.705864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.706042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.708408] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.708521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.708583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.708747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.708963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.716527] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b17ff089-f7e6-45c6-8675-a0bacc25487d in Status: IN_PROGRESS for 2s [ 945.717876] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: UNINITIALIZED for 2s [ 945.943058] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.439522] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-b895ed86-6e09-4e67-9271-3728fbd69e85 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 946.439522] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-b895ed86-6e09-4e67-9271-3728fbd69e85 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 946.439522] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-b895ed86-6e09-4e67-9271-3728fbd69e85 service nova] Enqueued Resource ID: d077af89-90c4-40b0-83b4-5695db24983a with Priority: HIGHEST for action port [ 946.439965] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 946.439965] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 946.439965] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d077af89-90c4-40b0-83b4-5695db24983a with Priority: HIGHEST for action port [ 946.440259] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.440434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.440685] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.440758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.440938] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d077af89-90c4-40b0-83b4-5695db24983a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.441067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.441113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.441305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.441382] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d077af89-90c4-40b0-83b4-5695db24983a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.445932] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4df507f-e3c4-414d-8e32-1d9e119b190a: rpc.has_security_group_logging(os_id): False [ 946.463491] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.463645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.463717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.463952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.464061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.464327] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.464455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.464519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.464683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.464805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.464852] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 946.523070] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.523195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.523239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.523789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.523789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.535459] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 946.945136] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d077af89-90c4-40b0-83b4-5695db24983a with status ACTIVE [ 946.945385] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.945651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.945651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.945911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.945911] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.946080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.946188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.946246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.946398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.946610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.946693] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.946778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.946830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.946932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.947015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.947103] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d077af89-90c4-40b0-83b4-5695db24983a is going to be updated. [ 946.966298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.966449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.966506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.966703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.966839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.966999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d077af89-90c4-40b0-83b4-5695db24983a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.053121] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 in Status: SUCCESS [ 947.053321] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b20bfe1-a213-442b-9906-0002d7f3fe25 deletion is rescheduled due to dependency. [ 947.053439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b20bfe1-a213-442b-9906-0002d7f3fe25" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.555496] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-76 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.555806] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.555845] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.557689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.557689] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.557689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.557689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.557689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.557689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.557689] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.557689] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.558088] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.558088] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.558159] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.558332] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.558556] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.577159] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.577441] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.578240] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.578240] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-76" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.578240] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-842841b6-cddc-4a74-97ce-22142309b9bc taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.578436] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.578436] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.578724] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.578863] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842841b6-cddc-4a74-97ce-22142309b9bc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.726355] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b17ff089-f7e6-45c6-8675-a0bacc25487d in Status: SUCCESS [ 947.726355] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b17ff089-f7e6-45c6-8675-a0bacc25487d deletion is rescheduled due to dependency. [ 947.726355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.727154] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.728674] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.728674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.728674] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.734351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.734351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.734351] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.734351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.734351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.734351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.734351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.734351] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.962617] env[64436]: INFO networking_nsxv3.common.synchronization [None req-219e847b-227a-4747-9fb1-bd63b19f3e0f tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 947.962617] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 947.963136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.964182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.964310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.964673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.964821] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.082232] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.082548] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.086064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.086064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.086064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.086064] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 842841b6-cddc-4a74-97ce-22142309b9bc not found, creating... [ 948.086064] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.086064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.086064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.086064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.086064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.086064] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.086519] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.086519] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.087447] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.087447] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.087447] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 842841b6-cddc-4a74-97ce-22142309b9bc is going to be created. [ 948.106844] env[64436]: INFO networking_nsxv3.common.synchronization [None req-43e5e52f-06ff-4da9-b7c5-fe233e19bbcc tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 948.107365] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 948.108767] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.109568] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.109723] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.109998] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.110249] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.110491] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.111503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.111607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.233663] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.233870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.234061] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.488857] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.489018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.489097] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.489317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.489421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.489669] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 already deleted. [ 948.489669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.489801] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.489926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.490011] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.549420] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 948.549420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.695387] env[64436]: INFO networking_nsxv3.common.synchronization [None req-988d99a5-f49c-4447-bba4-143db26edfb8 None None] Enqueued Resource ID: c67eb50a-1aba-4ee6-b3c6-abf8e4d67431 with Priority: HIGHEST for action port [ 948.695387] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c67eb50a-1aba-4ee6-b3c6-abf8e4d67431 with Priority: HIGHEST for action port [ 948.695915] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c67eb50a-1aba-4ee6-b3c6-abf8e4d67431 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.696074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c67eb50a-1aba-4ee6-b3c6-abf8e4d67431" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.696166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c67eb50a-1aba-4ee6-b3c6-abf8e4d67431" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.696522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c67eb50a-1aba-4ee6-b3c6-abf8e4d67431" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.696606] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c67eb50a-1aba-4ee6-b3c6-abf8e4d67431',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.740542] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.010646] env[64436]: INFO networking_nsxv3.common.synchronization [req-1d29c0d0-43c6-4f50-87cb-ca9b21be6246 req-8bfd1447-ac5d-4b37-bb05-64da17f7a5c5 tempest-ServerTagsTestJSON-113838391 tempest-ServerTagsTestJSON-113838391-project-member] Enqueued Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_members [ 949.011378] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGHEST for action security_group_members [ 949.011621] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.011812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.011854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.012220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.012403] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.012529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.012607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.012791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.012925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.012980] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.018884] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.018884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.018884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.018884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.018884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.018884] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 already deleted. [ 949.018884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.201572] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c67eb50a-1aba-4ee6-b3c6-abf8e4d67431 [ 949.201927] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.203029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.203029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.203029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.203029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.203029] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c67eb50a-1aba-4ee6-b3c6-abf8e4d67431 already deleted. [ 949.203029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c67eb50a-1aba-4ee6-b3c6-abf8e4d67431" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.242667] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.242854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.242952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.243212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.243384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.243494] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 949.267980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.268117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.268189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.268412] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.268561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.277214] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 949.293936] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-9b80d07e-6b3f-45b2-b7b4-df97cd6c1be9 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 949.294155] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-9b80d07e-6b3f-45b2-b7b4-df97cd6c1be9 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 949.294560] env[64436]: INFO networking_nsxv3.common.synchronization [req-237b71db-0c8c-4f62-89b7-8b752fa1b976 req-9b80d07e-6b3f-45b2-b7b4-df97cd6c1be9 service nova] Enqueued Resource ID: 842841b6-cddc-4a74-97ce-22142309b9bc with Priority: HIGHEST for action port [ 949.294826] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 949.294960] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 949.295065] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842841b6-cddc-4a74-97ce-22142309b9bc with Priority: HIGHEST for action port [ 949.296028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.296028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.296028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.296028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.296028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-842841b6-cddc-4a74-97ce-22142309b9bc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.296028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.296388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.296388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.296388] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842841b6-cddc-4a74-97ce-22142309b9bc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.515838] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.516014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.516014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.516277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.516340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.516558] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.516702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.516744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.516918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.516980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.517145] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e966668a-f00a-41f7-a7f9-623456edad39 is going to be updated. [ 949.542321] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.545017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.545017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.545017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.545017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.560826] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e966668a-f00a-41f7-a7f9-623456edad39 in Status: IN_PROGRESS for 2s [ 949.798864] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 842841b6-cddc-4a74-97ce-22142309b9bc with status ACTIVE [ 949.799234] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.799234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.799367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.799711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.799871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.800089] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.800200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.800265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.800441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.800537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.800766] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.800862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.800918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.801080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.801155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.801240] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 842841b6-cddc-4a74-97ce-22142309b9bc is going to be updated. [ 949.822274] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.822468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.822511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.822837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.823051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.823281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842841b6-cddc-4a74-97ce-22142309b9bc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.113457] env[64436]: INFO networking_nsxv3.common.synchronization [None req-9a783142-ef74-4925-a487-80b52ea00e59 None None] Enqueued Resource ID: 5c5c40f7-58b2-4155-b990-0beb8b5f1df9 with Priority: HIGHEST for action port [ 951.118228] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5c40f7-58b2-4155-b990-0beb8b5f1df9 with Priority: HIGHEST for action port [ 951.118228] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c5c40f7-58b2-4155-b990-0beb8b5f1df9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.118228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c5c40f7-58b2-4155-b990-0beb8b5f1df9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.118228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c5c40f7-58b2-4155-b990-0beb8b5f1df9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.118228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c5c40f7-58b2-4155-b990-0beb8b5f1df9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.118228] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c5c40f7-58b2-4155-b990-0beb8b5f1df9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.286075] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 951.286309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.286417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.286649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.286841] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.286997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.287103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.287179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.287258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.287497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.287707] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.287851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.287851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.288078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.288283] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.288395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.288480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.288635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.289252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.289369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.289574] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.290522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.294021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.294021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.294021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.294021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.294021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.294021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.294021] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.576245] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e966668a-f00a-41f7-a7f9-623456edad39 in Status: SUCCESS [ 951.576245] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e966668a-f00a-41f7-a7f9-623456edad39 deletion is rescheduled due to dependency. [ 951.576245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.620713] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c5c40f7-58b2-4155-b990-0beb8b5f1df9 [ 951.621136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.621351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.621446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.621669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.621781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.621915] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c5c40f7-58b2-4155-b990-0beb8b5f1df9 already deleted. [ 951.622017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c5c40f7-58b2-4155-b990-0beb8b5f1df9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.792958] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec771e5f-71e9-4435-a779-f87f1d12a98e: rpc.has_security_group_logging(os_id): False [ 951.794378] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.811033] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.811266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.811410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.811879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.811879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.812091] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.812213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.812284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.812451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.812622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.812742] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.812840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.812916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.813083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.813198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.813376] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.813475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.813538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.813682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.813823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.813865] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be created. [ 951.875386] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.875527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.875610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.875819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.876121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.889105] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 952.298157] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.800719] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.800825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.801259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.801259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.801259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.801441] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 952.827503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.827653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.827724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.827967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.828145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.836164] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 953.582149] env[64436]: INFO networking_nsxv3.common.synchronization [req-c352ec80-7f16-490f-bd91-9f1aa03f5899 req-89e2d55c-fc43-4223-9392-56449b9b0503 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 953.582695] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 953.583030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.583152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.583234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.583447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.583611] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.583728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.583782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.583957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.584052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.584147] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.903340] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 953.903340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.905154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.905154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.905154] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.913607] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.913891] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.914223] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.914560] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.914907] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.915138] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.915304] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.915578] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.915897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.916148] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.916265] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.916380] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.916489] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.916611] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.916724] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.916865] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.938084] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.938084] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 953.938084] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.938387] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.939019] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-57dbee2b-0a84-49a2-b63b-14a06de7af3b taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.939019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.939019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.939239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.939851] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57dbee2b-0a84-49a2-b63b-14a06de7af3b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.087069] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.087260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.087369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.087666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.087796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.088047] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.088175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.088254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.088424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.088508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.088777] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 954.111671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.111872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.111872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.112105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.112281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.120733] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 954.413630] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.413834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.442080] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.442321] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.442454] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.442732] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.442889] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.443058] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 57dbee2b-0a84-49a2-b63b-14a06de7af3b not found, creating... [ 954.443321] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.443482] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.443637] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.443813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.443955] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.444253] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.444413] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.444552] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.444812] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.444958] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.445116] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 57dbee2b-0a84-49a2-b63b-14a06de7af3b is going to be created. [ 954.462499] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.462710] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.462814] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.463075] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.463311] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.463539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.845310] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 954.845644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.845730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.845942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.846147] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.846266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.846364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.846488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.846569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.846651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.846741] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.209687] env[64436]: INFO networking_nsxv3.common.synchronization [req-c352ec80-7f16-490f-bd91-9f1aa03f5899 req-b46085ba-836f-4693-b0f3-001a8ffea37f service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 955.209687] env[64436]: INFO networking_nsxv3.common.synchronization [req-c352ec80-7f16-490f-bd91-9f1aa03f5899 req-b46085ba-836f-4693-b0f3-001a8ffea37f service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 955.209795] env[64436]: INFO networking_nsxv3.common.synchronization [req-c352ec80-7f16-490f-bd91-9f1aa03f5899 req-b46085ba-836f-4693-b0f3-001a8ffea37f service nova] Enqueued Resource ID: 57dbee2b-0a84-49a2-b63b-14a06de7af3b with Priority: HIGHEST for action port [ 955.210285] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 955.210422] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 955.210536] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57dbee2b-0a84-49a2-b63b-14a06de7af3b with Priority: HIGHEST for action port [ 955.210855] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.210974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.211228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.211369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.212775] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.215035] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.219076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.219331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-57dbee2b-0a84-49a2-b63b-14a06de7af3b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.219459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.219520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.219728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.219807] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57dbee2b-0a84-49a2-b63b-14a06de7af3b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.253713] env[64436]: INFO networking_nsxv3.common.synchronization [None req-874a137e-dfb1-478a-a234-27a35ee24635 None None] Enqueued Resource ID: 3dbca3ee-39de-4f47-b0b7-881d511775e3 with Priority: HIGHEST for action port [ 955.254356] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dbca3ee-39de-4f47-b0b7-881d511775e3 with Priority: HIGHEST for action port [ 955.254657] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dbca3ee-39de-4f47-b0b7-881d511775e3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.254782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dbca3ee-39de-4f47-b0b7-881d511775e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.254851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dbca3ee-39de-4f47-b0b7-881d511775e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.258346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dbca3ee-39de-4f47-b0b7-881d511775e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.258346] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dbca3ee-39de-4f47-b0b7-881d511775e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.278969] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 955.279102] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent loop - iteration:2 started [ 955.350984] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.350984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.350984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.350984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.350984] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.351361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.351361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.351361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.351462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.351535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.351723] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.351851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.351914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.352077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.352218] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.352313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.352438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.352619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.352619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.352735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.352735] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.721846] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.721846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.721846] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57dbee2b-0a84-49a2-b63b-14a06de7af3b with status ACTIVE [ 955.722076] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.722076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.722171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.722354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.722476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.722688] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.722888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.722888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.723204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.723204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.723401] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.723526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.724298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.724298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.724298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.724298] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57dbee2b-0a84-49a2-b63b-14a06de7af3b is going to be updated. [ 955.743377] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.743528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.743599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.744266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.744266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.744266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57dbee2b-0a84-49a2-b63b-14a06de7af3b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.759994] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dbca3ee-39de-4f47-b0b7-881d511775e3 [ 955.760426] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.760938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.760938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.761059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.761104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.761433] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dbca3ee-39de-4f47-b0b7-881d511775e3 already deleted. [ 955.761433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dbca3ee-39de-4f47-b0b7-881d511775e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.856016] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec771e5f-71e9-4435-a779-f87f1d12a98e: rpc.has_security_group_logging(os_id): False [ 955.931340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.931536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.931536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.932260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.932260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.932260] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.932260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.932260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.932528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.932528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.932612] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.932661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.932700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.932824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.932955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.933096] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.933193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.933248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.933380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.933478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.933542] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 956.009982] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.010147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.010215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.010417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.010582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.022207] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 956.130919] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 4s [ 957.222318] env[64436]: INFO networking_nsxv3.common.synchronization [None req-951fadad-d04b-445d-adc0-c4b6ca87fa71 None None] Enqueued Resource ID: c8f6dce2-d693-4422-b18d-150b54710d93 with Priority: HIGHEST for action port [ 957.223105] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8f6dce2-d693-4422-b18d-150b54710d93 with Priority: HIGHEST for action port [ 957.223587] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8f6dce2-d693-4422-b18d-150b54710d93 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.223818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8f6dce2-d693-4422-b18d-150b54710d93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.223962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8f6dce2-d693-4422-b18d-150b54710d93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.224360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8f6dce2-d693-4422-b18d-150b54710d93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.224480] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8f6dce2-d693-4422-b18d-150b54710d93',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.727495] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8f6dce2-d693-4422-b18d-150b54710d93 [ 957.727704] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.727834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.727909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.728281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.728410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.728474] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8f6dce2-d693-4422-b18d-150b54710d93 already deleted. [ 957.728573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8f6dce2-d693-4422-b18d-150b54710d93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.036978] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 958.037247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.037501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.037724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.037813] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.140329] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 958.140632] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 958.140782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.140951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.141174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.141364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.141483] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.141552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.141702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.141784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.141882] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.412101] env[64436]: INFO networking_nsxv3.common.synchronization [req-99ac15e6-4fd6-4bc5-9f5f-2735e4c3a4f1 req-63d4cf4b-9635-4920-a769-6089e3c43641 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 958.413180] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 958.413796] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.414086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.414274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.415859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.415859] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.415859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.415859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.415859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.415859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.415859] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.542416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.542416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.542416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.542416] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.644605] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.704608] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.704608] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.704608] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.704608] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.705272] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.708673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.708673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.708673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.708673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.708673] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.708673] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.708673] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.708673] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.708673] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.708673] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.708673] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.725093] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.725783] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.726104] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.726682] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.726838] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b59f56f5-066a-41a4-89e5-c0493bbf4d33 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.727161] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.727340] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.727882] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.728123] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b59f56f5-066a-41a4-89e5-c0493bbf4d33',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.917835] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.918076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.918125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.918358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.918451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.918676] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.918759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.918840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.918978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.919075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.919150] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c already deleted. [ 958.919232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.046601] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.046825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.046904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.047149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.047323] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.047498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.047592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.047755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.047873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.048248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.048248] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.048248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.048472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.048472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.048552] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.048648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.048711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.050459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.050642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.050764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.050862] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.147047] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.232077] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.232077] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.232320] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.232539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.232731] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.232901] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b59f56f5-066a-41a4-89e5-c0493bbf4d33 not found, creating... [ 959.233216] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.233383] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.233508] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.233750] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.233892] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.234350] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.237021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.237021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.237021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.237021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.237021] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b59f56f5-066a-41a4-89e5-c0493bbf4d33 is going to be created. [ 959.256837] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.257104] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.257242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.257566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.257813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.258255] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.554361] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec771e5f-71e9-4435-a779-f87f1d12a98e: rpc.has_security_group_logging(os_id): False [ 959.571192] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.571338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.571394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.571627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.571717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.571905] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.572077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.572150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.572310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.572385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.572574] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.572664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.572725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.572866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.573065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.573303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.573404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.573465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.573619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.573693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.573776] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 959.632325] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.632476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.632549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.633167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.633167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.646841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 959.652928] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.652928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.652928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.653206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.654442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.654572] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 959.761798] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.761964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.762053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.762283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.762449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.773430] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 960.258501] env[64436]: INFO networking_nsxv3.common.synchronization [req-99ac15e6-4fd6-4bc5-9f5f-2735e4c3a4f1 req-c9e4b1b3-c391-4aa0-9bc4-e5e4da307521 service nova] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_rules [ 960.258730] env[64436]: INFO networking_nsxv3.common.synchronization [req-99ac15e6-4fd6-4bc5-9f5f-2735e4c3a4f1 req-c9e4b1b3-c391-4aa0-9bc4-e5e4da307521 service nova] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 960.258929] env[64436]: INFO networking_nsxv3.common.synchronization [req-99ac15e6-4fd6-4bc5-9f5f-2735e4c3a4f1 req-c9e4b1b3-c391-4aa0-9bc4-e5e4da307521 service nova] Enqueued Resource ID: b59f56f5-066a-41a4-89e5-c0493bbf4d33 with Priority: HIGHEST for action port [ 960.259534] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_rules [ 960.259709] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 960.259817] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59f56f5-066a-41a4-89e5-c0493bbf4d33 with Priority: HIGHEST for action port [ 960.261767] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.261965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.262107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.262411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.262508] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.263464] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.264014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.264137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.264414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.264658] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.264827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.265034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.265248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.265439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.265580] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.266554] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b59f56f5-066a-41a4-89e5-c0493bbf4d33 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.266696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.266807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.267053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.267195] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b59f56f5-066a-41a4-89e5-c0493bbf4d33',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.390675] env[64436]: INFO networking_nsxv3.common.synchronization [req-91dc15e9-f726-4dd8-9b80-a7a7e4a54143 req-bc419e81-9dc9-4c5c-878c-87941e2302d8 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 960.391350] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 960.391676] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.391786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.391857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.392500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.392733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.392818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.392818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.392983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.393092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.393186] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.555399] env[64436]: INFO networking_nsxv3.common.synchronization [req-91dc15e9-f726-4dd8-9b80-a7a7e4a54143 req-c4ebdefb-d2fa-4460-a9ed-aef5106f3c29 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 960.556332] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 960.556379] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.556999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.746448] env[64436]: INFO networking_nsxv3.common.synchronization [req-91dc15e9-f726-4dd8-9b80-a7a7e4a54143 req-6b991b40-e90c-4d47-8311-e5170d59915f tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 960.748574] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 960.749265] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.749432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.770449] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.770449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.771319] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b59f56f5-066a-41a4-89e5-c0493bbf4d33 with status ACTIVE [ 960.771319] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.771658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.771782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.772115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.772407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.772636] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.773396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.773493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.773712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.773805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.774039] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.774262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.774262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.774477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.774720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.774720] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b59f56f5-066a-41a4-89e5-c0493bbf4d33 is going to be updated. [ 960.776295] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.806234] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.806498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.806498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.806814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.806814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.806993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b59f56f5-066a-41a4-89e5-c0493bbf4d33" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.896679] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.278914] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.399121] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.662385] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 961.662793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.783419] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 961.783733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.783977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.784303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.784578] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.784755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.784862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.785105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.785236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.785393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.785514] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.790176] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.790176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.790176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.790176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.790176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.790176] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be created. [ 961.812693] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.812921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.813042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.813358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.813626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.827456] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: UNINITIALIZED for 2s [ 961.900699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.900868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.900940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.901192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.901284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.901401] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 961.929427] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.929714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.929840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.930170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.930391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.942306] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 962.197167] env[64436]: INFO networking_nsxv3.common.synchronization [req-a629df9b-3e64-4b84-ae67-4dbf404518fa req-8d8cba4d-faf0-482a-a630-ea09a24ab5b1 tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_members [ 962.197620] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGHEST for action security_group_members [ 962.198170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.198170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.199285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.199285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.199285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.199285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.199285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.199285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.199285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.199285] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.290199] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.290404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.290404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.291630] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.291630] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.291630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.292201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.292201] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.292201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.292201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.292340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.292340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.292407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.293025] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.702210] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.702496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.702496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.702667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.722850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.723280] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.723852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.723852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.723852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.723852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.724077] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca0f983-827d-4279-9163-19aa19101851 is going to be updated. [ 962.748880] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.749040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.749115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.749327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.749488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.758361] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca0f983-827d-4279-9163-19aa19101851 in Status: IN_PROGRESS for 2s [ 962.796108] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f75433d-92b0-49c0-b145-a45f748925ab: rpc.has_security_group_logging(os_id): False [ 962.813208] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.813351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.813480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.814810] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.814810] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.814810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.815450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.815450] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.815450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.815450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.815596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.815627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.815717] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 962.886645] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.886792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 962.886869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.887104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 962.887256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 962.902036] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 963.537023] env[64436]: INFO networking_nsxv3.common.synchronization [req-064ecf59-e7e0-498e-9d58-53942d6011b5 req-5d917bdb-c1ec-4ce2-ba2a-a2c807d8d908 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 963.537023] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 963.537462] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.537600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.537643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.537992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.538716] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.538716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.538716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.538716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.539131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.539131] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.817901] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.818198] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.818198] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.818880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.818880] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.818880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.819150] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.819264] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.819413] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.820103] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.820103] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.820103] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.820103] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.820384] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.820384] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.820384] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.836215] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 963.836419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.836572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.836758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.836966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.837098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.837374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.837374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.837374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.837511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.837561] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.839797] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.839964] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.840123] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.840314] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.840581] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-a45f2c2a-d745-4163-99b9-d782c7dd19de taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.840731] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.840856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.841147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.841285] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a45f2c2a-d745-4163-99b9-d782c7dd19de',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.950709] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 963.950907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.951089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.951298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.951660] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.951660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.951660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.951818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.951903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.951947] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.043212] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.043212] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.043212] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 already deleted. [ 964.043212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.339679] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.339919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.340008] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.340288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.340507] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.340757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.340840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.341088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.341212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.341319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.341494] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.341600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.341737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.341936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.342172] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.342300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.342352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.342517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.342617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.342706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.342800] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.345041] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.345041] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.345041] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.345285] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.345459] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.345694] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port a45f2c2a-d745-4163-99b9-d782c7dd19de not found, creating... [ 964.346010] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.346235] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.346775] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.346829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.346957] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.347317] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.347642] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.347837] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.348073] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.348227] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.348375] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: a45f2c2a-d745-4163-99b9-d782c7dd19de is going to be created. [ 964.367632] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.367868] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.367934] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.368239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.368482] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.368801] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.456049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.456049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.456049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.456049] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 964.481972] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.482213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.482278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.482566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.482710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.493824] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 964.767857] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca0f983-827d-4279-9163-19aa19101851 in Status: SUCCESS [ 964.767857] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca0f983-827d-4279-9163-19aa19101851 deletion is rescheduled due to dependency. [ 964.768100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.850738] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e217869-d443-46d3-8722-54105951b88c: rpc.has_security_group_logging(os_id): False [ 964.867950] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.868118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.868208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.868479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.868574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.868833] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.868957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.869062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.869238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.869343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.869582] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.869690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.869772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.870104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.870205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.870437] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.870541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.870611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.870770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.870851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.870972] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be created. [ 964.917061] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 964.917235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.923906] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.924087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.924139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.924310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.924527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.934426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: IN_PROGRESS for 2s [ 965.088262] env[64436]: INFO networking_nsxv3.common.synchronization [req-064ecf59-e7e0-498e-9d58-53942d6011b5 req-c2b5a298-4fbd-4322-b223-4be73266cf60 service nova] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 965.088262] env[64436]: INFO networking_nsxv3.common.synchronization [req-064ecf59-e7e0-498e-9d58-53942d6011b5 req-c2b5a298-4fbd-4322-b223-4be73266cf60 service nova] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 965.088262] env[64436]: INFO networking_nsxv3.common.synchronization [req-064ecf59-e7e0-498e-9d58-53942d6011b5 req-c2b5a298-4fbd-4322-b223-4be73266cf60 service nova] Enqueued Resource ID: a45f2c2a-d745-4163-99b9-d782c7dd19de with Priority: HIGHEST for action port [ 965.088262] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 965.088262] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 965.088262] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a45f2c2a-d745-4163-99b9-d782c7dd19de with Priority: HIGHEST for action port [ 965.091843] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.091843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.091843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.091843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.091843] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.094347] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.094789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.095496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.095496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.095496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.095496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.095496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.095719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.095719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.095859] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.096708] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a45f2c2a-d745-4163-99b9-d782c7dd19de taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.096832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.097095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.097095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.097161] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a45f2c2a-d745-4163-99b9-d782c7dd19de',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.603527] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.604501] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.604639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.604781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a45f2c2a-d745-4163-99b9-d782c7dd19de with status ACTIVE [ 965.604930] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.605064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.605110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.605670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.605670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.605670] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.605670] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.605879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.605879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.605938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.606088] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.606173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.606230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.606365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.607027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.607027] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a45f2c2a-d745-4163-99b9-d782c7dd19de is going to be updated. [ 965.628077] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.628077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.628077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.628077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.628077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.628377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a45f2c2a-d745-4163-99b9-d782c7dd19de" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.834020] env[64436]: INFO networking_nsxv3.common.synchronization [req-c89adaab-d3f4-4d3b-9a1e-8af818cc5111 req-446b89df-c87b-4e5d-b929-2e93798d9b96 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 965.834020] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 965.834020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.834407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.834675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.835019] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.835295] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.835536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.835689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.835965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.836181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.836380] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.109938] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.117275] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.117729] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.117890] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.118522] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.118947] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.119565] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.119763] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.120319] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.120319] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.120621] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.120797] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.120966] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.121145] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.121312] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.121623] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.121692] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.144699] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.144882] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.145034] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.145226] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.145548] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-8e55e0bd-9037-4828-9d2d-251c055ee026 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.145726] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.145851] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.146721] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.146721] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e55e0bd-9037-4828-9d2d-251c055ee026',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.340331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.340331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.340331] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 already deleted. [ 966.340331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.502853] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 966.503218] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e deletion is rescheduled due to dependency. [ 966.503340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.503499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.503771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.503980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.504142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.504229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.504415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.504535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.504655] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.612737] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.612958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.613034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.613248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.613341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.613438] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be created. [ 966.634368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.634495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.634570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.634777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.634934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.642731] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: UNINITIALIZED for 2s [ 966.649757] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.649757] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.649757] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.649757] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.650212] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.650212] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 8e55e0bd-9037-4828-9d2d-251c055ee026 not found, creating... [ 966.650335] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.650541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.650684] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.650989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.651227] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.651622] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.651809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.651957] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.652195] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.652338] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.652483] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 8e55e0bd-9037-4828-9d2d-251c055ee026 is going to be created. [ 966.669984] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.670216] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.670454] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.670560] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.671013] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.671013] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.947137] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 966.947298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.007485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.007648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.007783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.008031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.008153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.008404] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.008480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.008571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.008730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.008812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.008903] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 967.031354] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.031768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.031989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.033030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.033030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.040920] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 967.420393] env[64436]: INFO networking_nsxv3.common.synchronization [req-c89adaab-d3f4-4d3b-9a1e-8af818cc5111 req-7e9ba195-5310-4126-a99b-316df0e1d1c1 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 967.420393] env[64436]: INFO networking_nsxv3.common.synchronization [req-c89adaab-d3f4-4d3b-9a1e-8af818cc5111 req-7e9ba195-5310-4126-a99b-316df0e1d1c1 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 967.420393] env[64436]: INFO networking_nsxv3.common.synchronization [req-c89adaab-d3f4-4d3b-9a1e-8af818cc5111 req-7e9ba195-5310-4126-a99b-316df0e1d1c1 service nova] Enqueued Resource ID: 8e55e0bd-9037-4828-9d2d-251c055ee026 with Priority: HIGHEST for action port [ 967.420393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 967.420393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 967.420393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e55e0bd-9037-4828-9d2d-251c055ee026 with Priority: HIGHEST for action port [ 967.420393] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.420393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.420393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.421092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.421271] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.422762] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.423030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.423185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.423501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.423840] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.424061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.424234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.424527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.425234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.425234] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.425892] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e55e0bd-9037-4828-9d2d-251c055ee026 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.426722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.426722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.426722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.426722] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e55e0bd-9037-4828-9d2d-251c055ee026',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.928505] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.928634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.928831] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e55e0bd-9037-4828-9d2d-251c055ee026 with status ACTIVE [ 967.929009] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.929129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.929186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.929401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.929493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.929727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.929822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.929874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.930043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.930122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.930300] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.930395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.930454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.930613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.930689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.930771] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e55e0bd-9037-4828-9d2d-251c055ee026 is going to be updated. [ 967.931813] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.951670] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.951807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.951887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.952187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.952335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.952489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e55e0bd-9037-4828-9d2d-251c055ee026" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.200369] env[64436]: INFO networking_nsxv3.common.synchronization [req-26fee642-dfce-45bd-ab3e-8871a73cc41e req-0f47d78f-89c9-4866-aec0-80370f761cfb tempest-InstanceActionsV221TestJSON-680874564 tempest-InstanceActionsV221TestJSON-680874564-project-member] Enqueued Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_members [ 968.201153] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_members [ 968.201467] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.201652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.201652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.201899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.202060] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.202164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.202227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.202375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.202460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.202571] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.237406] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.237564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.237629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.238070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.238070] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.434422] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.537246] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.537510] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-328" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.537648] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-328" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.538024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-328" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.538463] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.538641] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.538767] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.539014] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.539200] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.539430] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.539565] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.539727] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.539850] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.539972] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.540101] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.540248] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.557652] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.557870] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 968.557988] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.558205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-328" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.558549] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-89b1b127-9afb-41cd-ba39-5b872e76090c taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.558773] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.558911] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.559354] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.559420] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b1b127-9afb-41cd-ba39-5b872e76090c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.651523] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 968.651758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.651919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.652160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.652350] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.652464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.652529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.652682] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.652766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.652849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.652937] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.705110] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.705110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.705110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.705110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.705364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.705364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.705453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.705521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.705681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.705990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.705990] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 already deleted. [ 968.706103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.743683] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.937101] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.937252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.937301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.937565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.937695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.937797] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be created. [ 968.960472] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.960673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.960737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.960965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.961139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.968979] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: UNINITIALIZED for 2s [ 969.014971] env[64436]: INFO networking_nsxv3.common.synchronization [req-ad4ee446-d102-4963-9409-56262f59e027 req-66dd8c16-c1b4-4a24-ab09-b84cfa6e8b47 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 969.015497] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 969.015833] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.015976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.016082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.016325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.016520] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.016624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.016711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.016872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.016980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.017089] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.049699] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 969.049911] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e deletion is rescheduled due to dependency. [ 969.050054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.063509] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.063733] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.063924] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.064249] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.064429] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.064616] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 89b1b127-9afb-41cd-ba39-5b872e76090c not found, creating... [ 969.064888] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.065093] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.065260] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.065541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.065703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.066029] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.066239] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.066406] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.066686] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.066894] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.067111] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 89b1b127-9afb-41cd-ba39-5b872e76090c is going to be created. [ 969.086987] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.087237] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.087368] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.087730] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.088056] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.088424] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.155310] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.246874] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.519549] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.519887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.519887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.520209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.520263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.520493] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.520679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.520767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.520948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.521067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.521161] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 969.546560] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.546973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.547133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.547325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.547488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.556311] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 969.657414] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b271b036-4ee8-48b7-9a6a-455fa62def61: rpc.has_security_group_logging(os_id): False [ 969.676042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.676685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.676853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.677113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.677224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.677559] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.677701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.677731] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.677890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.677984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.678087] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be created. [ 969.729239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.729393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.729466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.729742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.730505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.740218] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: IN_PROGRESS for 2s [ 969.749056] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 969.749181] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 969.910727] env[64436]: INFO networking_nsxv3.common.synchronization [req-26fee642-dfce-45bd-ab3e-8871a73cc41e req-a79e0626-a8d2-42da-a091-0dac4b015867 service nova] Enqueued Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_rules [ 969.910936] env[64436]: INFO networking_nsxv3.common.synchronization [req-26fee642-dfce-45bd-ab3e-8871a73cc41e req-a79e0626-a8d2-42da-a091-0dac4b015867 service nova] Enqueued Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_members [ 969.911137] env[64436]: INFO networking_nsxv3.common.synchronization [req-26fee642-dfce-45bd-ab3e-8871a73cc41e req-a79e0626-a8d2-42da-a091-0dac4b015867 service nova] Enqueued Resource ID: 89b1b127-9afb-41cd-ba39-5b872e76090c with Priority: HIGHEST for action port [ 969.911352] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_rules [ 969.911476] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_members [ 969.911570] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b1b127-9afb-41cd-ba39-5b872e76090c with Priority: HIGHEST for action port [ 969.913850] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.913986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.914075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.914328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.914437] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.915239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.915369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.915435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.915587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.915728] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.915822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.915883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.916028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.916115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.916202] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.919653] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b1b127-9afb-41cd-ba39-5b872e76090c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.921037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.921037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.921037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.921037] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b1b127-9afb-41cd-ba39-5b872e76090c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.422273] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.424044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.424044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.424044] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89b1b127-9afb-41cd-ba39-5b872e76090c with status ACTIVE [ 970.424044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.424044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.424044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.424304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.424304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.424349] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.424445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.424478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.424625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.424701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.424875] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.424968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.425039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.425180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.425315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.425315] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89b1b127-9afb-41cd-ba39-5b872e76090c is going to be updated. [ 970.444850] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.444998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.445078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.445269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.445403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.445549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b1b127-9afb-41cd-ba39-5b872e76090c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.598122] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.598395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.598395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.598504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.612244] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 970.613114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.614118] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 970.646341] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.646341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.646341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.646524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.655826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.656574] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 970.656574] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 970.656680] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 970.694398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.694594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.694632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.695101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.696166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.696352] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 970.762996] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.763209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.763304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.763575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.763984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.764391] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 970.827525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.827673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.827741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.827950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.828237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.828509] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 970.828601] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0af8c995-71f2-4efa-a95d-9e0e461fe445', '23b08457-f786-4357-ae40-5bf7a012b659', '78d49cf6-2072-4cc7-8ae1-6c40d6bd584a', '3a7c16cc-25b5-4f14-86e6-c0818627fd71', '2392c42b-4327-4a1f-85ce-846d4a8981fc', '187248ab-d2a0-4cf9-a442-d5273f2938e3', '0f75433d-92b0-49c0-b145-a45f748925ab', '1e217869-d443-46d3-8722-54105951b88c', '156f1116-13ef-448f-a7e6-f12ab165da73', '37fe26d6-f782-4509-b81f-40a0eeb20894', 'd4e1163d-f97e-451a-89d1-745f57f66535', '439934dd-a8d0-443b-bef1-613de792a394', '5a84c314-4b02-42db-a1d1-74e8ea62582f', '1c72e70d-81aa-4c66-a80b-9d5f04b046c1', 'ab78b72f-7655-492a-8135-613a26cfa217', 'e966668a-f00a-41f7-a7f9-623456edad39', 'b17ff089-f7e6-45c6-8675-a0bacc25487d', '6b966170-3dea-4773-8900-e7034ff19049', '053dde8f-4d20-4a6f-8b2d-d0a125c40782', 'b271b036-4ee8-48b7-9a6a-455fa62def61', 'f8d51f49-2f07-4baa-93f3-f28849ea55ba', 'ec771e5f-71e9-4435-a779-f87f1d12a98e', '3ca0f983-827d-4279-9163-19aa19101851', '9741d578-5b29-42b0-b0b6-dfd97b1c7306', '2a7055f1-b6d2-4437-9167-b5ee510dd08a', 'aeeb0085-3d91-4859-b6e8-d553406b2219', 'f24df5e6-b8ac-4b7a-898c-90fa972dda35', 'fbe8273e-23a4-44f7-a432-9d347c32cd2d', 'ad80987d-a16f-49ad-a3ce-836e3cca1187', '6c2d8d81-8cc8-44df-9d77-63cb789204d8', 'ddee3b8b-6805-4cc6-99b5-47b0c8059fc3', '80355bd7-8e39-4ae8-bf46-4d775230b0d4', 'f7502962-276d-43f0-96f0-2447f12d3137', 'af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9', 'cfb4c1c6-2021-458b-840f-cd83ee502c3d', '3cc5500f-a0f5-4e87-aa9b-0020789243e9', '8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e', '6d226089-248b-47ba-bfe1-ba9fc67ca294', 'b915a177-2742-49be-9ca9-2dc30ee9c6ac', 'a9ef4caa-55e7-4f89-9577-78cea5744bdb', 'c2485258-5c59-4503-a9df-3f4d9b5bebdb', '3ed89fd9-eeee-4f35-9707-895a0fcd48b0', 'e04160bc-db4b-4c32-8c62-3a41769c7c95', '0477e290-dfb6-401d-bc8e-f26e35953b43', 'd1017fee-6833-4760-849a-3861937d36d9', 'a22f030d-b590-48f1-adde-d139f2aa31d4', '377c820a-e6ee-48bb-9450-abc7d40a08d0', '1b20bfe1-a213-442b-9906-0002d7f3fe25', 'c4df507f-e3c4-414d-8e32-1d9e119b190a', '73a0cec9-fcd4-4729-abd7-b50d1439753c'} {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 970.828708] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 970.849048] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.849270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.849270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.849475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.849560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.849675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 970.849745] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 970.849817] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 970.914829] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.914996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.915060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.915261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.916291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.916535] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 970.916615] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 970.916688] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 970.916754] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 970.916831] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 970.916900] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGH for action security_group_rules [ 970.916980] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGH for action security_group_rules [ 970.917057] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGH for action security_group_rules [ 970.917119] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGH for action security_group_rules [ 970.917182] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGH for action security_group_rules [ 970.917243] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGH for action security_group_rules [ 970.917332] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGH for action security_group_rules [ 970.917429] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGH for action security_group_rules [ 970.917429] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGH for action security_group_rules [ 970.917485] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGH for action security_group_rules [ 970.917585] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGH for action security_group_rules [ 970.917585] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGH for action security_group_rules [ 970.917682] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGH for action security_group_rules [ 970.917728] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGH for action security_group_rules [ 970.917771] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGH for action security_group_rules [ 970.917810] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGH for action security_group_rules [ 970.917873] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGH for action security_group_rules [ 970.917923] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGH for action security_group_rules [ 970.917989] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGH for action security_group_rules [ 970.918058] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGH for action security_group_rules [ 970.918155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.927633] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.980415] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.980415] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.980415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.980415] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.430601] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.430788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.430896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.431122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.431216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.431315] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 is going to be created. [ 971.454696] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.454929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.454929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.455106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.455265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.466591] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 in Status: UNINITIALIZED for 2s [ 971.482286] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.482462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.482594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.482807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.483029] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.483157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.483224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.483439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.483537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.483667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.483866] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.483978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.484085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.484241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.484386] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.484518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.484587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.484776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.484910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.485042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.485169] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.566034] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 971.566034] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 971.566221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.751719] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 971.752071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.987969] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b396e974-2fce-4ce5-a60d-a8bc929e40e2: rpc.has_security_group_logging(os_id): False [ 972.005308] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.005476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.005562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.005813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.005909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.006129] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.006251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.006315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.006497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.006599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.006792] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.006921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.006986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.007142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.007243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.007444] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.007538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.008886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.008886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.008886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.008886] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be created. [ 972.057714] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.057918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.058020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.058316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.058543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.068362] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 973.475847] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 in Status: SUCCESS [ 973.476128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.476245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.476450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.476634] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.476755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.476816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.476961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.477052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.477200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.477307] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.979845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.980027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.980106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.980429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.980494] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.980609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.980675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.980795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.980883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.980972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.981535] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.981535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.981535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.981535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.981535] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.981775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.981775] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.981838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.981862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.981996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.982055] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.082397] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 974.082678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.484405] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb19e790-7043-4bc8-8786-ef2a1406ff06: rpc.has_security_group_logging(os_id): False [ 974.544800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.544800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.544800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.544800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.545302] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.545302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.545302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.545302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.545302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.545302] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 is going to be created. [ 974.578611] env[64436]: INFO networking_nsxv3.common.synchronization [None req-e3eb0a1c-8039-4038-b87b-40494e0a58c8 tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_rules [ 974.579316] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_rules [ 974.579554] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGH for action security_group_rules [ 974.579704] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a with Priority: HIGH for action security_group_rules [ 974.579986] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGH for action security_group_rules [ 974.579986] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab78b72f-7655-492a-8135-613a26cfa217 with Priority: HIGH for action security_group_rules [ 974.580118] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGH for action security_group_rules [ 974.580274] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 with Priority: HIGH for action security_group_rules [ 974.580390] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b966170-3dea-4773-8900-e7034ff19049 with Priority: HIGH for action security_group_rules [ 974.580536] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17ff089-f7e6-45c6-8675-a0bacc25487d with Priority: HIGH for action security_group_rules [ 974.580640] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 with Priority: HIGH for action security_group_rules [ 974.580747] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e966668a-f00a-41f7-a7f9-623456edad39 with Priority: HIGH for action security_group_rules [ 974.580887] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGH for action security_group_rules [ 974.580995] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439934dd-a8d0-443b-bef1-613de792a394 with Priority: HIGH for action security_group_rules [ 974.581119] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1163d-f97e-451a-89d1-745f57f66535 with Priority: HIGH for action security_group_rules [ 974.581247] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 with Priority: HIGH for action security_group_rules [ 974.581682] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156f1116-13ef-448f-a7e6-f12ab165da73 with Priority: HIGH for action security_group_rules [ 974.581738] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 with Priority: HIGH for action security_group_rules [ 974.581846] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGH for action security_group_rules [ 974.581943] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc with Priority: HIGH for action security_group_rules [ 974.582075] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b08457-f786-4357-ae40-5bf7a012b659 with Priority: HIGH for action security_group_rules [ 974.582176] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 with Priority: HIGH for action security_group_rules [ 974.582547] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee94a361-ec26-4356-a9e8-dacb252b81bb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.582772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.582772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.583050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.583164] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.584138] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.584391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.584530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.584759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.584862] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.585965] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.586192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.586251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.586501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.586617] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78d49cf6-2072-4cc7-8ae1-6c40d6bd584a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.590585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.590585] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.590585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab78b72f-7655-492a-8135-613a26cfa217 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.590585] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab78b72f-7655-492a-8135-613a26cfa217',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.590585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.590585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.590585] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.591342] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.591445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.591530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.591772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.591772] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('053dde8f-4d20-4a6f-8b2d-d0a125c40782',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.593236] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b966170-3dea-4773-8900-e7034ff19049 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.593338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.593399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.593556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.593612] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b966170-3dea-4773-8900-e7034ff19049',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.594641] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b17ff089-f7e6-45c6-8675-a0bacc25487d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.594748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.594810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.595057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.595057] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b17ff089-f7e6-45c6-8675-a0bacc25487d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.595680] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.595843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.596055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.596289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.596375] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c72e70d-81aa-4c66-a80b-9d5f04b046c1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.597211] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e966668a-f00a-41f7-a7f9-623456edad39 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.597330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.597394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.597540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.597608] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e966668a-f00a-41f7-a7f9-623456edad39',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.598356] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.598547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.598547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.598829] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.598987] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.599747] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-439934dd-a8d0-443b-bef1-613de792a394 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.600126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.600126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.600126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.600126] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('439934dd-a8d0-443b-bef1-613de792a394',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.604717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4e1163d-f97e-451a-89d1-745f57f66535 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.604828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.604912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.605098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.605170] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4e1163d-f97e-451a-89d1-745f57f66535',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.606060] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37fe26d6-f782-4509-b81f-40a0eeb20894 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.606168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.606244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.606441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.606514] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37fe26d6-f782-4509-b81f-40a0eeb20894',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.608573] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156f1116-13ef-448f-a7e6-f12ab165da73 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.608700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.608808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.608982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.609067] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156f1116-13ef-448f-a7e6-f12ab165da73',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.609834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187248ab-d2a0-4cf9-a442-d5273f2938e3 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.609951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.610011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.610181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.610311] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187248ab-d2a0-4cf9-a442-d5273f2938e3',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.611212] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.611333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.611674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.611835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.612144] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.612607] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2392c42b-4327-4a1f-85ce-846d4a8981fc taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.612707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.612764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.613300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.613379] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2392c42b-4327-4a1f-85ce-846d4a8981fc',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.615305] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23b08457-f786-4357-ae40-5bf7a012b659 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.615305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.615305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.615305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.615305] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23b08457-f786-4357-ae40-5bf7a012b659',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.615968] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.616106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.616167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.616326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.616400] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a7c16cc-25b5-4f14-86e6-c0818627fd71',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.620383] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.620505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.620595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.620754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.620930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.658260] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 in Status: IN_PROGRESS for 2s [ 974.663518] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.663679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.663752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.664464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.676765] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.676765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.686457] env[64436]: INFO networking_nsxv3.common.synchronization [None req-9c88a407-246d-494f-a391-b18668442d46 tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_rules [ 974.687067] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_rules [ 974.687401] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee94a361-ec26-4356-a9e8-dacb252b81bb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.687543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.704438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.704992] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b966170-3dea-4773-8900-e7034ff19049 is going to be deleted. [ 974.706221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.706491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.730234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.731333] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c72e70d-81aa-4c66-a80b-9d5f04b046c1 is going to be deleted. [ 974.764031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.764308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.764430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.764898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.765023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.765169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b966170-3dea-4773-8900-e7034ff19049" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.776762] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.776924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.776999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.777236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.777337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.777456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c72e70d-81aa-4c66-a80b-9d5f04b046c1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.125361] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.125944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.125944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.125944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.126117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.126181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.126433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.126433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.126519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.126614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.126705] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.133252] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.133397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.133469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.133702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.133772] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.134010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.134010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.134092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.134167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.134288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.134383] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.138195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.138325] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.138368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.141470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.141663] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.141783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.141850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.143262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.143262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.143262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.143262] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.149440] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.149440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.149965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.150191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.150361] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.150468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.150531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.150686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.150888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.151381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.151381] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.164137] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.164137] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.164137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.164137] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.164640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.164640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.164640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.164640] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.165009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.165009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.165009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.165120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.168158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.168158] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.207826] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.207826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.207826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.207826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.212392] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.212563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.218016] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.218016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.219836] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.219980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.226575] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.226734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.227823] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.227823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.228682] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.230201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.230201] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.230201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.230315] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.230430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.231699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.231699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.237298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.237298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.237298] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 975.237298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.237298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.239351] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 975.239848] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.239967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.243199] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 975.243738] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.243895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.248192] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 975.248745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.248893] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78d49cf6-2072-4cc7-8ae1-6c40d6bd584a is going to be deleted. [ 975.250066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.250332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.261733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.261875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.288668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.288715] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156f1116-13ef-448f-a7e6-f12ab165da73 is going to be deleted. [ 975.289702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.289995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.316227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.316429] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 053dde8f-4d20-4a6f-8b2d-d0a125c40782 is going to be deleted. [ 975.321638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.321994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.323486] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.323589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.339722] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.339865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.370463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.370595] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37fe26d6-f782-4509-b81f-40a0eeb20894 is going to be deleted. [ 975.371534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.371752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.407257] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.407257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.423406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.423406] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 439934dd-a8d0-443b-bef1-613de792a394 is going to be deleted. [ 975.424545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.424876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.459804] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.460062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.468030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.468030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b17ff089-f7e6-45c6-8675-a0bacc25487d is going to be deleted. [ 975.468766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.468990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.505689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.505972] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a7c16cc-25b5-4f14-86e6-c0818627fd71 is going to be deleted. [ 975.506786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.506994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.528149] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.528149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.577660] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.577660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.587892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.588094] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2392c42b-4327-4a1f-85ce-846d4a8981fc is going to be deleted. [ 975.589048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.589425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.621800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.621913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.626476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.626605] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be deleted. [ 975.627523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.628150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.630454] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.660201] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.662419] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.662419] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.662419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.662419] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.662864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.662864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.662864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.662943] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.663569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.663687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.663903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.663985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.664089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.664200] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.679861] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0af8c995-71f2-4efa-a95d-9e0e461fe445: rpc.has_security_group_logging(os_id): False [ 975.691888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.692067] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4e1163d-f97e-451a-89d1-745f57f66535 is going to be deleted. [ 975.692872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.693102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.698778] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.698937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.737448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.737592] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab78b72f-7655-492a-8135-613a26cfa217 is going to be deleted. [ 975.738577] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.738794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.738885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.738980] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee94a361-ec26-4356-a9e8-dacb252b81bb already deleted. [ 975.739079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.739239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.739391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.740230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.740391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.740474] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.771449] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.771650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.778900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.779183] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23b08457-f786-4357-ae40-5bf7a012b659 is going to be deleted. [ 975.780199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.780370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.816504] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.816632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.834320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.834511] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187248ab-d2a0-4cf9-a442-d5273f2938e3 is going to be deleted. [ 975.835476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.835711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.837176] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.837287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.880910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.881042] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e966668a-f00a-41f7-a7f9-623456edad39 is going to be deleted. [ 975.883469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.883469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.883469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.883469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78d49cf6-2072-4cc7-8ae1-6c40d6bd584a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.884750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.884750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.884750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.884750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156f1116-13ef-448f-a7e6-f12ab165da73" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.884909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.885139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.885265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.885437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-053dde8f-4d20-4a6f-8b2d-d0a125c40782" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.885629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.885874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.886077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.887098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37fe26d6-f782-4509-b81f-40a0eeb20894" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.887310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.887506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.887620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.887842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-439934dd-a8d0-443b-bef1-613de792a394" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.888440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.888791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.888915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.889108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b17ff089-f7e6-45c6-8675-a0bacc25487d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.889285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.889490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.889604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.889869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a7c16cc-25b5-4f14-86e6-c0818627fd71" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.890072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.890296] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.890576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.890576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2392c42b-4327-4a1f-85ce-846d4a8981fc" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.890686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.890871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.915541] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.915783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.939425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.939803] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.939931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.940034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.940247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.940335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.940553] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.940683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.940737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.940936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.941465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.941736] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.942144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.942144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.942144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.942281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.942321] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be updated. [ 975.943462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.943645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.943728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.943843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.943996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.944178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.944251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.944374] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4e1163d-f97e-451a-89d1-745f57f66535" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.944531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.944690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.944773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.944898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab78b72f-7655-492a-8135-613a26cfa217" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.954916] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.957158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.957158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.957158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.957158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.957158] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187248ab-d2a0-4cf9-a442-d5273f2938e3" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.963760] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.963760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.963760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.964240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.964240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.964240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23b08457-f786-4357-ae40-5bf7a012b659" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.018653] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.018653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.018653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.018653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.018653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.018653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e966668a-f00a-41f7-a7f9-623456edad39" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.076817] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 976.076817] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.076817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.077138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.077138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.077481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.111171] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: IN_PROGRESS for 2s [ 976.133801] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b271b036-4ee8-48b7-9a6a-455fa62def61: rpc.has_security_group_logging(os_id): False [ 976.169023] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.169023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.169023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.169023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.169364] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e217869-d443-46d3-8722-54105951b88c: rpc.has_security_group_logging(os_id): False [ 976.171163] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a84c314-4b02-42db-a1d1-74e8ea62582f: rpc.has_security_group_logging(os_id): False [ 976.217828] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.217986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.220803] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.220803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.227585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.228800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.229082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.229082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.230118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.230118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.230118] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be updated. [ 976.231934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.231934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.265360] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.265360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.270476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.270674] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.270802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.270875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.271094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.271179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.271321] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f is going to be updated. [ 976.272401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.272638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.297526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.298214] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.298357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.298429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.298648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.298735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.298943] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.299054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.299117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.299287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.299366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.299555] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.299638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.299728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.299872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.299948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.300048] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be updated. [ 976.301460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.301663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.301780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.301900] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee94a361-ec26-4356-a9e8-dacb252b81bb already deleted. [ 976.302022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.328853] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.329084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.329189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.329434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.329622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.354343] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: IN_PROGRESS for 2s [ 976.365087] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.365749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.365852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.366518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.366657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.384856] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: IN_PROGRESS for 2s [ 976.417661] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.417830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.417830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.418023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.418203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.452904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: IN_PROGRESS for 2s [ 976.669798] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 in Status: SUCCESS [ 976.669798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.137413] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 978.137971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.366330] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 978.366561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.397611] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: SUCCESS [ 978.397611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.464104] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 978.464388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.643199] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-7199f7cf-aace-4c9d-95c1-56118be2cbf0 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 978.643730] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 978.644041] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.644161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.644227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.644414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.644562] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.644657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.644715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.644851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.644929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.645738] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.943027] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-f242be47-7215-43a4-8ac6-0809e47b61c6 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 978.943567] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 978.943878] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.944382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.149609] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.149609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.149609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.149609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.168306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.169568] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.169568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.169568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.169568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.169568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.169568] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 979.193799] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.193985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.194073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.194287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.194431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.202289] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 979.253767] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.253991] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-90" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.254138] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-90" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.254486] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-90" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.254754] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.254922] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.255058] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.255290] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.255450] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.255664] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.255797] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.255965] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.256153] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.256308] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.256495] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.256581] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.276439] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.276620] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.276841] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.276956] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-90" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.277283] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.277463] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.277591] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.277958] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.278129] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ca337ef-3e4a-4e6c-aebd-0ec446527e17',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.781302] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.781426] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.781544] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.781844] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.782064] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.782259] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 7ca337ef-3e4a-4e6c-aebd-0ec446527e17 not found, creating... [ 979.782561] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.782738] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.782916] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.783133] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.783285] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.783868] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.783868] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.784029] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.784723] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.784874] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.785093] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 7ca337ef-3e4a-4e6c-aebd-0ec446527e17 is going to be created. [ 979.827253] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.827532] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.827653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.828036] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.828635] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.828972] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.500508] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-63ac23ee-c285-4f52-9796-945f94760d91 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 980.500921] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-63ac23ee-c285-4f52-9796-945f94760d91 service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 980.501178] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-63ac23ee-c285-4f52-9796-945f94760d91 service nova] Enqueued Resource ID: 7ca337ef-3e4a-4e6c-aebd-0ec446527e17 with Priority: HIGHEST for action port [ 980.501847] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 980.502057] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 980.502275] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca337ef-3e4a-4e6c-aebd-0ec446527e17 with Priority: HIGHEST for action port [ 980.502624] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.502802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.502921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.504183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.504183] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.504761] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.504907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.505259] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.505394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.505501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.505778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.505905] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ca337ef-3e4a-4e6c-aebd-0ec446527e17',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.008244] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.008358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.008531] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ca337ef-3e4a-4e6c-aebd-0ec446527e17 with status ACTIVE [ 981.008713] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.010117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.010117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.010117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.010592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.010592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.011102] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ca337ef-3e4a-4e6c-aebd-0ec446527e17 is going to be updated. [ 981.030480] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.030627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.030702] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.030913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.031053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.031209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ca337ef-3e4a-4e6c-aebd-0ec446527e17" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.032907] env[64436]: INFO networking_nsxv3.common.synchronization [req-d211cfae-31f0-4f71-a392-e7cb3700cef3 req-14151c08-dcaf-47d2-ab70-40723ccac144 tempest-InstanceActionsV221TestJSON-680874564 tempest-InstanceActionsV221TestJSON-680874564-project-member] Enqueued Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_members [ 981.035335] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGHEST for action security_group_members [ 981.035924] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.036055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.036125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.036322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.036484] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.036583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.036647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.036797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.036881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.036986] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.213328] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 981.213580] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e deletion is rescheduled due to dependency. [ 981.213715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.213835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.214088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.214276] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.214394] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.214459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.214616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.214714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.214809] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.287630] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.287915] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-591" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.288115] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-591" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.288495] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-591" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.288778] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.289388] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.289388] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.289632] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.289834] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.290115] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.290240] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.290432] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.290558] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.290681] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.290813] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.290988] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.314239] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.314429] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.314575] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.314772] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-591" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.315129] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-263f04e4-1c58-4946-abdf-f1ad0c97865e taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.315319] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.315448] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.315809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.315971] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('263f04e4-1c58-4946-abdf-f1ad0c97865e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.543643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.544014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.544014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.544213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.544339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.544570] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.544730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.544805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.544965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.545055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.545142] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 is going to be updated. [ 981.571678] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.571832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.571954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.572170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.572316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.580184] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 in Status: IN_PROGRESS for 2s [ 981.717067] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.818308] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.818548] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.818686] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.818986] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.819171] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.819329] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 263f04e4-1c58-4946-abdf-f1ad0c97865e not found, creating... [ 981.819590] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.819789] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.819919] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.820166] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.820311] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.820595] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.820769] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.820888] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.821132] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.821295] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.821441] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 263f04e4-1c58-4946-abdf-f1ad0c97865e is going to be created. [ 981.842391] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.842583] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.842711] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.842991] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.843243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.843471] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.050337] env[64436]: INFO networking_nsxv3.common.synchronization [req-89af4fee-f979-42a6-9e51-171152c24818 req-428d1ece-c1a0-4163-8b1a-173b0d382319 tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_members [ 982.050873] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_members [ 982.051234] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee94a361-ec26-4356-a9e8-dacb252b81bb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.051385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.051477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.051769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.051971] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.052111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.052195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.052384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.052468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.052597] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.219608] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.436519] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.436745] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.436873] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.437185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.437481] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.437645] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.437771] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.438177] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.438378] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.438597] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.438713] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.438833] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.438943] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.439530] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.439530] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.439530] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.463693] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.463920] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 982.464157] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.464388] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-414" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.464773] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-33530080-8065-416b-90c6-4c8caf409962 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.465007] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.465175] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.465541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.465719] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33530080-8065-416b-90c6-4c8caf409962',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.554955] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.555365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.555365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.555471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.555511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.555710] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.555834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.555881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.556030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.556111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.556287] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee94a361-ec26-4356-a9e8-dacb252b81bb already deleted. [ 982.556336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.614824] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-4c5a0fa9-a9a0-47dd-8273-69337835c11a service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 982.615030] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-4c5a0fa9-a9a0-47dd-8273-69337835c11a service nova] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 982.615177] env[64436]: INFO networking_nsxv3.common.synchronization [req-ca1a9f92-127b-4f2a-bcc6-99e031c09cd1 req-4c5a0fa9-a9a0-47dd-8273-69337835c11a service nova] Enqueued Resource ID: 263f04e4-1c58-4946-abdf-f1ad0c97865e with Priority: HIGHEST for action port [ 982.615408] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_rules [ 982.615537] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 982.615634] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263f04e4-1c58-4946-abdf-f1ad0c97865e with Priority: HIGHEST for action port [ 982.616322] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.616527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.616716] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.616827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.617053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-263f04e4-1c58-4946-abdf-f1ad0c97865e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.617200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.617284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.617503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.617666] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('263f04e4-1c58-4946-abdf-f1ad0c97865e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.722443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.722630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.722665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.722892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.722984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.723097] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 982.747959] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.748168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.748168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.748470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.748657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.756308] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 982.968787] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.968787] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.968787] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.968787] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.969535] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.969609] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 33530080-8065-416b-90c6-4c8caf409962 not found, creating... [ 982.970550] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.970550] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.970550] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.970550] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.970768] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.970991] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.971242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.971391] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.971897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.971897] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.971897] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 33530080-8065-416b-90c6-4c8caf409962 is going to be created. [ 982.989986] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.990229] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.990360] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.990640] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.990926] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.991192] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.120600] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 263f04e4-1c58-4946-abdf-f1ad0c97865e with status ACTIVE [ 983.120887] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.121081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.121125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.121331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.121436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.121618] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.121729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.121785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.121921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.122018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.122196] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.122286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.122369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.122496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.122561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.122644] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 263f04e4-1c58-4946-abdf-f1ad0c97865e is going to be updated. [ 983.146927] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.146927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.146927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.147192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.147384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.147664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-263f04e4-1c58-4946-abdf-f1ad0c97865e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.592410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 in Status: SUCCESS [ 983.592696] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 deletion is rescheduled due to dependency. [ 983.592744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.705462] env[64436]: INFO networking_nsxv3.common.synchronization [req-89af4fee-f979-42a6-9e51-171152c24818 req-a0241ab5-6afe-4ea0-ba68-56f8423bebc7 service nova] Enqueued Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_rules [ 983.705775] env[64436]: INFO networking_nsxv3.common.synchronization [req-89af4fee-f979-42a6-9e51-171152c24818 req-a0241ab5-6afe-4ea0-ba68-56f8423bebc7 service nova] Enqueued Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_members [ 983.706752] env[64436]: INFO networking_nsxv3.common.synchronization [req-89af4fee-f979-42a6-9e51-171152c24818 req-a0241ab5-6afe-4ea0-ba68-56f8423bebc7 service nova] Enqueued Resource ID: 33530080-8065-416b-90c6-4c8caf409962 with Priority: HIGHEST for action port [ 983.706752] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_rules [ 983.706979] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_members [ 983.707230] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33530080-8065-416b-90c6-4c8caf409962 with Priority: HIGHEST for action port [ 983.708673] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee94a361-ec26-4356-a9e8-dacb252b81bb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.708673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.708673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.708673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.708673] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.709657] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee94a361-ec26-4356-a9e8-dacb252b81bb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.709832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.709940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.710228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.710476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.710632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.710739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.710981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.711186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.711369] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.712115] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-33530080-8065-416b-90c6-4c8caf409962 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.712282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.712387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.712755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.712755] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33530080-8065-416b-90c6-4c8caf409962',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.215028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33530080-8065-416b-90c6-4c8caf409962 with status ACTIVE [ 984.215529] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.215529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.215529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.215745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.215840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.216030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.216140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.216203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.216357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.216433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.216962] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.216962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.216962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.216962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.216962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.217161] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33530080-8065-416b-90c6-4c8caf409962 is going to be updated. [ 984.218775] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.219750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee94a361-ec26-4356-a9e8-dacb252b81bb taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.219750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.238742] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.238873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.238948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.239164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.239299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.239465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33530080-8065-416b-90c6-4c8caf409962" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.584492] env[64436]: INFO networking_nsxv3.common.synchronization [req-edfe1fce-71d0-453a-8844-ad691878d5e8 req-b8546d40-97cd-48b3-8532-461b95963a91 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 984.585047] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 984.585361] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.585482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.585551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.585749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.585903] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.586009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.587564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.587753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.587943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.587995] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.721295] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.766007] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 984.766243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.766401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.766612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.766792] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.766906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.766971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.767525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.767736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.767880] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.002204] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.002402] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.002568] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.002838] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.003128] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.003311] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.003417] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.003660] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.003805] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.004038] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.004172] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.004254] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.004386] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.004481] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.004590] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.004734] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.021706] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.021926] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.022113] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.022330] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.022675] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.023289] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.023289] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.023383] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.023554] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e6d9ad-a62f-4716-9c06-2b1b131fb85c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.089704] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.227415] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.227623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.227623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.227818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.227899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.228029] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee94a361-ec26-4356-a9e8-dacb252b81bb is going to be created. [ 985.255566] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.255756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.255912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.256211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.256452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.267044] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee94a361-ec26-4356-a9e8-dacb252b81bb in Status: UNINITIALIZED for 2s [ 985.271238] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.526220] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.526349] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.526466] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.526761] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.526920] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.527092] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d7e6d9ad-a62f-4716-9c06-2b1b131fb85c not found, creating... [ 985.527357] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.527523] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.527648] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.527885] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.528037] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.528335] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.528498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.528622] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.528834] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.528977] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.529149] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d7e6d9ad-a62f-4716-9c06-2b1b131fb85c is going to be created. [ 985.552837] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.552837] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.552837] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.553073] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.553107] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.553878] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.592109] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.773640] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.987946] env[64436]: INFO networking_nsxv3.common.synchronization [req-2b1ee8da-5f70-473b-b063-1a6a4e9ae3d4 req-938f4523-6260-4a30-b51f-0db7f2af02d3 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 985.988520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 985.988846] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.988983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.989068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.989265] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.989427] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.989524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.989583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.989727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.989836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.989949] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.094784] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.094932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.095017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.095249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.095336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.095446] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be updated. [ 986.124210] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.124339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.124406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.124617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.124756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.136180] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: IN_PROGRESS for 2s [ 986.223695] env[64436]: INFO networking_nsxv3.common.synchronization [req-edfe1fce-71d0-453a-8844-ad691878d5e8 req-4f3c4192-604d-42c9-9b6c-6920f65daa32 service nova] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 986.223887] env[64436]: INFO networking_nsxv3.common.synchronization [req-edfe1fce-71d0-453a-8844-ad691878d5e8 req-4f3c4192-604d-42c9-9b6c-6920f65daa32 service nova] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 986.224041] env[64436]: INFO networking_nsxv3.common.synchronization [req-edfe1fce-71d0-453a-8844-ad691878d5e8 req-4f3c4192-604d-42c9-9b6c-6920f65daa32 service nova] Enqueued Resource ID: d7e6d9ad-a62f-4716-9c06-2b1b131fb85c with Priority: HIGHEST for action port [ 986.224270] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_rules [ 986.224407] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 986.224504] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7e6d9ad-a62f-4716-9c06-2b1b131fb85c with Priority: HIGHEST for action port [ 986.225079] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.225225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.225282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.225478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.225558] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.226369] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.226488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.227859] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.227859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.227859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.227859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.227859] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e6d9ad-a62f-4716-9c06-2b1b131fb85c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.275748] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.275895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.275970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.276186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.276279] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.276374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 986.303500] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.303638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.303703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.303900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.304057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.312087] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 986.492589] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.492589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.492589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.492821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.492917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.493123] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.493227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.493290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.493441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.493518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.493601] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be updated. [ 986.517532] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.517713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.517758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.518309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.518475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.526045] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: IN_PROGRESS for 2s [ 986.728719] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.729167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.729547] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7e6d9ad-a62f-4716-9c06-2b1b131fb85c with status ACTIVE [ 986.729741] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.729909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.729978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.730202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.730294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.730478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.730586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.730651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.730809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.730889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.731079] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.731194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.731264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.731383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.731456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.731539] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7e6d9ad-a62f-4716-9c06-2b1b131fb85c is going to be updated. [ 986.752233] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.752415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.752502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.752709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.752847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.753022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7e6d9ad-a62f-4716-9c06-2b1b131fb85c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.970691] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a3d969-9ede-479e-849b-b03a20462167 req-be89326d-b3d5-4853-a025-4d0a28abafc9 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 986.971420] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 986.971776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.972171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.972312] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.972571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.972798] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.972979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.973107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.973321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.973457] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.973592] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.279719] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee94a361-ec26-4356-a9e8-dacb252b81bb in Status: SUCCESS [ 987.280685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.281251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.281512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.282529] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.282688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.282780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.282972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.283103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.283545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.283649] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.476993] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.477203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.477271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.477491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.477586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.477804] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.477921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.477987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.478165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.478314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.478418] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be deleted. [ 987.515246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.515246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.515246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.515246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.515246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.515246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.785721] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.963909] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.964185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.964358] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.964661] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.966012] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.966012] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.966012] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.966012] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.966012] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.966334] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.966334] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.966523] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.966572] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.966686] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.966804] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.967275] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.985316] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.985581] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 987.985655] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.985915] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-517" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.986255] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-a31d94fa-05e9-4b7b-a171-0887d6d13f57 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.987159] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.988295] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.990042] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.990042] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a31d94fa-05e9-4b7b-a171-0887d6d13f57',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.146036] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 988.146036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.146036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.146036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.146367] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.146367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.146367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.146553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.146553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.146643] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.290275] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee94a361-ec26-4356-a9e8-dacb252b81bb: rpc.has_security_group_logging(os_id): False [ 988.305211] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.305390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.305453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.306949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.306949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.306949] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.306949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.306949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.306949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.306949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.306949] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee94a361-ec26-4356-a9e8-dacb252b81bb is going to be created. [ 988.320946] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 988.320946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.320946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.320946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.321156] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.321341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.324102] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.324102] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.324102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.324102] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.368754] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.368754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.368754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.368754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.368754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.385074] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee94a361-ec26-4356-a9e8-dacb252b81bb in Status: IN_PROGRESS for 2s [ 988.492852] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.492852] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.492852] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.493105] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.493105] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.493223] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port a31d94fa-05e9-4b7b-a171-0887d6d13f57 not found, creating... [ 988.493490] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.493655] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.493778] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.493996] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.494154] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.494434] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.494593] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.494715] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.494926] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.495083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.495229] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: a31d94fa-05e9-4b7b-a171-0887d6d13f57 is going to be created. [ 988.514708] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.514889] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.515031] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.515264] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.515482] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.515703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.541190] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 988.541311] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c deletion is rescheduled due to dependency. [ 988.541425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.648511] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.825675] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.825882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.826021] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.150775] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.330485] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.503612] env[64436]: INFO networking_nsxv3.common.synchronization [req-990153ae-eaae-4f99-983a-d7df2f7b9463 req-72646df7-9bf9-4cf6-873f-e6d15f3a90e4 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 989.504112] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 989.504441] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.504558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.504626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.504821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.504966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.506114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.506172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.506388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.506512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.506629] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.579024] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a3d969-9ede-479e-849b-b03a20462167 req-edef5053-04a4-4492-a94f-121f5b7f6bbf service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 989.579210] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a3d969-9ede-479e-849b-b03a20462167 req-edef5053-04a4-4492-a94f-121f5b7f6bbf service nova] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 989.579348] env[64436]: INFO networking_nsxv3.common.synchronization [req-50a3d969-9ede-479e-849b-b03a20462167 req-edef5053-04a4-4492-a94f-121f5b7f6bbf service nova] Enqueued Resource ID: a31d94fa-05e9-4b7b-a171-0887d6d13f57 with Priority: HIGHEST for action port [ 989.582155] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_rules [ 989.582155] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 989.582155] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31d94fa-05e9-4b7b-a171-0887d6d13f57 with Priority: HIGHEST for action port [ 989.582155] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.582155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.582155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.582155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.582155] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.586158] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.586286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.586355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.586538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.586689] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.586795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.586836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.586979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.587072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.587162] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.587906] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-a31d94fa-05e9-4b7b-a171-0887d6d13f57 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.588013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.588091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.588243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.588312] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a31d94fa-05e9-4b7b-a171-0887d6d13f57',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.653204] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.653364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.653437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.655343] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.655459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.655588] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be updated. [ 989.685766] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.685966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.686067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.686327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.686500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.695052] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: IN_PROGRESS for 2s [ 989.832955] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.833155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.833228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.833420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.833511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.833610] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 989.850138] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.850698] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.850960] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.851403] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.852358] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.852643] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.853295] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.853689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.853944] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.854325] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.854548] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.854766] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.854977] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.855213] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.855432] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.855668] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.883169] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.883354] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 989.883518] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.883707] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.884132] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-3a522ef8-15d1-4758-937e-23bf075418eb taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.884359] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.884493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.884825] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.884973] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a522ef8-15d1-4758-937e-23bf075418eb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.896619] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.896788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.896821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.897054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.897198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.905195] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 990.009088] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.090236] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.090405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.090551] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.091494] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a31d94fa-05e9-4b7b-a171-0887d6d13f57 with status ACTIVE [ 990.091680] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.091798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.091863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.092087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.092176] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.092345] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.092455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.092489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.092645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.092721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.092926] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.093091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.093219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.093403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.093403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.093466] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a31d94fa-05e9-4b7b-a171-0887d6d13f57 is going to be updated. [ 990.115967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.116173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.116277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.116602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.116789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.116995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a31d94fa-05e9-4b7b-a171-0887d6d13f57" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.389214] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.389579] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.389653] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.390021] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.390188] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.390364] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 3a522ef8-15d1-4758-937e-23bf075418eb not found, creating... [ 990.390622] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.390806] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.390948] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.391200] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.391337] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.391625] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.391786] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.391912] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.392141] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.392284] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.392428] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 3a522ef8-15d1-4758-937e-23bf075418eb is going to be created. [ 990.398675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee94a361-ec26-4356-a9e8-dacb252b81bb in Status: SUCCESS [ 990.398867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.411762] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.411947] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.412091] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.412334] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.412556] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.412770] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.511425] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.595840] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.013802] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.013973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.014069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.014296] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.014388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.014492] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 991.043140] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.043298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.043361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.043551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.043692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.052116] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 991.083475] env[64436]: INFO networking_nsxv3.common.synchronization [req-990153ae-eaae-4f99-983a-d7df2f7b9463 req-a1a5741a-e71d-46ca-a8b1-9fa6d43e10a4 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 991.083684] env[64436]: INFO networking_nsxv3.common.synchronization [req-990153ae-eaae-4f99-983a-d7df2f7b9463 req-a1a5741a-e71d-46ca-a8b1-9fa6d43e10a4 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 991.083833] env[64436]: INFO networking_nsxv3.common.synchronization [req-990153ae-eaae-4f99-983a-d7df2f7b9463 req-a1a5741a-e71d-46ca-a8b1-9fa6d43e10a4 service nova] Enqueued Resource ID: 3a522ef8-15d1-4758-937e-23bf075418eb with Priority: HIGHEST for action port [ 991.084081] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 991.084204] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 991.084302] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a522ef8-15d1-4758-937e-23bf075418eb with Priority: HIGHEST for action port [ 991.084835] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.084956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.085966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.085966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.085966] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.086729] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.086851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.087057] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a522ef8-15d1-4758-937e-23bf075418eb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.087136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.087185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.087323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.088093] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a522ef8-15d1-4758-937e-23bf075418eb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.098815] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.098938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.099020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.099218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.099320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.099587] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be created. [ 991.124295] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.124540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.124672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.124928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.125152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.134884] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: UNINITIALIZED for 2s [ 991.589085] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.589474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.589474] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a522ef8-15d1-4758-937e-23bf075418eb with status ACTIVE [ 991.591186] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.591186] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.591186] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.591186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.591759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.591759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.591759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.591759] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a522ef8-15d1-4758-937e-23bf075418eb is going to be updated. [ 991.611228] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.611362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.611433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.611647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.611786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.611971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a522ef8-15d1-4758-937e-23bf075418eb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.704896] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 991.705346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.705346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.705421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.706053] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.707509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.707509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.707509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.707509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.707509] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.707509] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.914911] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 991.915174] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.915364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.915561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.915782] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.915922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.916009] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.916217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.916298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.916508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.916708] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.916708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.916859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.916974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.917145] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.917290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.917359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.917504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.917717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.917717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.917812] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.213162] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.424040] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec771e5f-71e9-4435-a779-f87f1d12a98e: rpc.has_security_group_logging(os_id): False [ 992.455303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.455498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.455606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.455842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.455951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.456233] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.456371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.456459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.456668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.456784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.457241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.457414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.457492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.457683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.457805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.458061] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.458213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.458306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.458490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.458603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.458723] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 992.534261] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.534430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.534715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.534837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.535340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.548755] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 992.716042] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b271b036-4ee8-48b7-9a6a-455fa62def61: rpc.has_security_group_logging(os_id): False [ 992.741761] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.741761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.741761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.741973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.742115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.742426] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.742552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.742619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.742785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.742866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.742959] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be updated. [ 992.806270] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.806424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.806615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.806707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.806893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.819943] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: IN_PROGRESS for 2s [ 993.062774] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 993.062774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.062774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.062774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.062774] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.062774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.062774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.062774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.062774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.062774] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.144588] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 993.144852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.145039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.145269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.145463] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.145584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.145689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.145856] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.145940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.149192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.149405] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.565291] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.652071] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.652071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.652321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.652359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.652539] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.652641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.652705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.652850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.652938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.653036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.653184] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.653272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.653332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.653467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.653616] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.653710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.653767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.653904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.653978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.654071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.654163] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.068672] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.160963] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f75433d-92b0-49c0-b145-a45f748925ab: rpc.has_security_group_logging(os_id): False [ 994.181897] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.181897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.181897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.181897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.181897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.182089] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.182089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.182157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.182649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.182649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.182649] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.182878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.182878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.182929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.183012] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.183924] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.185637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.185745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.185937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.186052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.187207] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be created. [ 994.240412] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.240616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.240717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.240983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.241199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.255649] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 994.291175] env[64436]: INFO networking_nsxv3.common.synchronization [req-3d730ea4-551b-4bba-9a6a-e1899c2c66ea req-b29f94cc-9375-445b-ab91-d65f2081ee88 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 994.291686] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 994.291996] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.292131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.292187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.292383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.292537] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.292631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.292693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.292838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.292986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.293487] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.514496] env[64436]: INFO networking_nsxv3.common.synchronization [req-3d730ea4-551b-4bba-9a6a-e1899c2c66ea req-85881193-0038-4687-b598-d79135434e08 tempest-ServersTestMultiNic-813906185 tempest-ServersTestMultiNic-813906185-project-member] Enqueued Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 994.514496] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec771e5f-71e9-4435-a779-f87f1d12a98e with Priority: HIGHEST for action security_group_members [ 994.514496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec771e5f-71e9-4435-a779-f87f1d12a98e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.514496] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.566101] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 994.566347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.567294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.567455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.567546] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.571729] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.571729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.571729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.571935] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.571935] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.572013] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 994.601318] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.601318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.601318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.601318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.601318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.611402] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 994.796052] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.834045] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 994.834286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.093598] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.094090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.094090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.094090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.094216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.094427] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be deleted. [ 995.160639] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.160639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.160639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.160639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.160804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.160804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.300859] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.803855] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.804083] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.804212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.804500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.804652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.804783] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be updated. [ 995.830013] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.830188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.830264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.830436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.830578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.838202] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: IN_PROGRESS for 2s [ 996.273699] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 996.275978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.620836] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 996.622871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.622871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.622871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.622871] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.622871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 996.622871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.622871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 996.623206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.623206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 996.623206] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.060278] env[64436]: INFO networking_nsxv3.common.synchronization [None req-c5b8763d-334e-4c5d-9d33-c651960a7303 None None] Enqueued Resource ID: d72700bb-2aaf-4b8d-95fd-68ad6e93389c with Priority: HIGHEST for action port [ 997.061525] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72700bb-2aaf-4b8d-95fd-68ad6e93389c with Priority: HIGHEST for action port [ 997.061525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d72700bb-2aaf-4b8d-95fd-68ad6e93389c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.061727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d72700bb-2aaf-4b8d-95fd-68ad6e93389c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.061837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d72700bb-2aaf-4b8d-95fd-68ad6e93389c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.062193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d72700bb-2aaf-4b8d-95fd-68ad6e93389c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.062306] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72700bb-2aaf-4b8d-95fd-68ad6e93389c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.126872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.126872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.126872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.127622] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.127891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.128162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.128548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.128816] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.129199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.129403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.129974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.130222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.131839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.131839] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.142978] env[64436]: INFO networking_nsxv3.common.synchronization [None req-5b8127f7-5120-4f92-9737-e9e8be1adc6b tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_rules [ 997.145281] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_rules [ 997.145281] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.146369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.146640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.147034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.147288] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.289215] env[64436]: INFO networking_nsxv3.common.synchronization [None req-249b0c63-78f9-433e-808c-41f6fe71e6c0 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_rules [ 997.289979] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_rules [ 997.290323] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.290421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.566595] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d72700bb-2aaf-4b8d-95fd-68ad6e93389c [ 997.566595] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.566595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.566595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.566595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.566595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.566595] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d72700bb-2aaf-4b8d-95fd-68ad6e93389c already deleted. [ 997.566595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d72700bb-2aaf-4b8d-95fd-68ad6e93389c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.635125] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b396e974-2fce-4ce5-a60d-a8bc929e40e2: rpc.has_security_group_logging(os_id): False [ 997.653503] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.653503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.653503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.655045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.655045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.655045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.655045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.655045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.655045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.655045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.655045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.656205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.656205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.656205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.656205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.656205] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.656205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.656205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.656205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.656463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.656463] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 997.679336] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.679336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.679336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.679336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.679336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.679336] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 already deleted. [ 997.679336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.679336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.679336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.679336] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.714500] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.714862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.715039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.715449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.715734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.730913] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 997.849387] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec771e5f-71e9-4435-a779-f87f1d12a98e in Status: SUCCESS [ 997.850148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.850148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.850148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.850257] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.850342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.850401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.850561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.850644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.850737] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec771e5f-71e9-4435-a779-f87f1d12a98e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.221133] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.221133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.221133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.221133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.221133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.221133] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 already deleted. [ 998.221133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.354199] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.357123] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.357123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.357123] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec771e5f-71e9-4435-a779-f87f1d12a98e is going to be deleted. [ 998.384438] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.384591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.384652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.384854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.384956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.385070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec771e5f-71e9-4435-a779-f87f1d12a98e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.403648] env[64436]: INFO networking_nsxv3.common.synchronization [None req-5c7baa90-94ab-41c7-adbc-2f331f7478e3 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 998.404220] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 998.404575] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.404687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.404755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.404993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.405864] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.405864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.405864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.405864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.405864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.405864] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.907987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.909697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.909697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.909697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.934527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.934708] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.934835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.934906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.935127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.935289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.935389] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 998.960625] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.960928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.961033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.961257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.961403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.969936] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 999.241490] env[64436]: INFO networking_nsxv3.common.synchronization [None req-fcfd7cb0-dfc8-4aec-95fd-ee061474be97 None None] Enqueued Resource ID: c6f0bb5e-0307-4e8c-8003-163d2c4dabd1 with Priority: HIGHEST for action port [ 999.241783] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f0bb5e-0307-4e8c-8003-163d2c4dabd1 with Priority: HIGHEST for action port [ 999.242364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6f0bb5e-0307-4e8c-8003-163d2c4dabd1 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.242490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6f0bb5e-0307-4e8c-8003-163d2c4dabd1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.242559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6f0bb5e-0307-4e8c-8003-163d2c4dabd1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.243461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6f0bb5e-0307-4e8c-8003-163d2c4dabd1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.243554] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6f0bb5e-0307-4e8c-8003-163d2c4dabd1',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.746245] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 999.746606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.746703] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6f0bb5e-0307-4e8c-8003-163d2c4dabd1 [ 999.746930] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.747075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.747155] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.747364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.747447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.747532] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6f0bb5e-0307-4e8c-8003-163d2c4dabd1 already deleted. [ 999.747611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6f0bb5e-0307-4e8c-8003-163d2c4dabd1" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.980131] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 1000.980493] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 deletion is rescheduled due to dependency. [ 1000.980546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.648605] env[64436]: INFO networking_nsxv3.common.synchronization [req-6dd42fd0-03d4-43ce-b8bd-443c7c741b63 req-ad5cf989-6f42-4804-93c7-a008fee9b7ed tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1001.648943] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1001.649220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.649424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.649424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.649593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.649854] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.649854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.650232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.650232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.650232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.650310] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.152969] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.152969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.152969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.153598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.176038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.176038] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.176038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.176038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.176038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.176038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.176038] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1002.198458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.198458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.198458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.198458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.198458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.207083] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1004.217666] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1004.218727] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 deletion is rescheduled due to dependency. [ 1004.218882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.541238] env[64436]: INFO networking_nsxv3.common.synchronization [req-898ed0f2-1a2b-4426-bb9c-fa0f79a1bfd6 req-381b0716-44f4-439c-a6ac-52d9bca551e9 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1006.541820] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1006.542125] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.542253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.542328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.542586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.542660] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.542781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.542855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.543016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.543152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.543247] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.046040] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.549405] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.051615] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.051862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.051862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.052088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.052188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.052302] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1008.078536] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.078690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.078725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.078906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.079074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.087233] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1009.682574] env[64436]: INFO networking_nsxv3.common.synchronization [req-b2466f40-009a-4dcf-ac23-248eae1891c2 req-43dab1f1-142e-4283-8ad6-2d7d0fa63668 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_members [ 1009.682815] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_members [ 1009.683316] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.683316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.683316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.684098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.684098] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.684098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.684098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.684098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.684323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.684323] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.020798] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.021013] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.021013] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.021648] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.021953] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.022382] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.022537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.022799] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.022956] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.023219] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.023332] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.023454] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.023568] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.023682] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.023792] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.023933] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.043090] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.043271] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.043421] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.043670] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.044016] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-da515b81-cf8c-415b-a1b0-b50a4c424583 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.044210] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.044340] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.044685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.044833] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da515b81-cf8c-415b-a1b0-b50a4c424583',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.098426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1010.098662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.186537] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.186712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.186833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.187106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.187218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.187427] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.187538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.187731] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.187777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.187830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.187911] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 already deleted. [ 1010.187992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.547476] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.547476] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.547693] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.547813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.548030] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.548157] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port da515b81-cf8c-415b-a1b0-b50a4c424583 not found, creating... [ 1010.548416] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.548673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.548802] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.549054] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.549707] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.549795] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.550073] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.550128] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.550348] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.550583] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.550642] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: da515b81-cf8c-415b-a1b0-b50a4c424583 is going to be created. [ 1010.568719] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.568946] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.569105] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.569400] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.569637] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.569869] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.263106] env[64436]: INFO networking_nsxv3.common.synchronization [req-b2466f40-009a-4dcf-ac23-248eae1891c2 req-c09c4285-d7fb-4f50-b825-49f4e9f49573 service nova] Enqueued Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_rules [ 1011.263373] env[64436]: INFO networking_nsxv3.common.synchronization [req-b2466f40-009a-4dcf-ac23-248eae1891c2 req-c09c4285-d7fb-4f50-b825-49f4e9f49573 service nova] Enqueued Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_members [ 1011.263426] env[64436]: INFO networking_nsxv3.common.synchronization [req-b2466f40-009a-4dcf-ac23-248eae1891c2 req-c09c4285-d7fb-4f50-b825-49f4e9f49573 service nova] Enqueued Resource ID: da515b81-cf8c-415b-a1b0-b50a4c424583 with Priority: HIGHEST for action port [ 1011.263678] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_rules [ 1011.263770] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_members [ 1011.263881] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da515b81-cf8c-415b-a1b0-b50a4c424583 with Priority: HIGHEST for action port [ 1011.264453] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.264578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.264647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.264848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.264922] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.267044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.267167] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.267238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.267410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.267562] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.267662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.267728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.267863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.267948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.268058] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.269179] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-da515b81-cf8c-415b-a1b0-b50a4c424583 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.269291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.269372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.269767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.269849] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da515b81-cf8c-415b-a1b0-b50a4c424583',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.769072] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.769072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.769858] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.770960] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da515b81-cf8c-415b-a1b0-b50a4c424583 with status ACTIVE [ 1011.771184] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.771327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.771397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.771624] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.771733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.771946] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.772059] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.772132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.772747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.772747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.772747] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.772747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.773057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.773057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.773057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.773186] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da515b81-cf8c-415b-a1b0-b50a4c424583 is going to be updated. [ 1011.792805] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.792966] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.793050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.793316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.793463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.793632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da515b81-cf8c-415b-a1b0-b50a4c424583" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.085670] env[64436]: INFO networking_nsxv3.common.synchronization [req-cb7e44ec-6754-4d74-ba40-0ac796e1bafb req-1085a1f5-8f5b-4060-9d3a-0426cba13e82 tempest-ServerPasswordTestJSON-649739366 tempest-ServerPasswordTestJSON-649739366-project-member] Enqueued Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_members [ 1012.086292] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_members [ 1012.086523] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.086650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.086720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.086997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.087172] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.087438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.087438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.087565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.087610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.087707] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.275720] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.412358] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-709 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.412574] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-709" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.412707] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-709" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.413076] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-709" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.413356] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.413528] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.413650] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.413878] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.414046] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.414262] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.414381] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.414495] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.414604] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.414716] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.414826] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.415266] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.437596] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.437596] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1012.437596] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.437596] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-709" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.437596] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-c8b37272-3a52-4265-b223-86ff61e17e4d taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.437596] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.437596] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.437596] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.437596] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8b37272-3a52-4265-b223-86ff61e17e4d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.589567] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.589810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.589810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.590107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.590256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.590479] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.590594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.590669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.590850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.590961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.591066] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 already deleted. [ 1012.591141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.780491] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.780667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.780727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.780948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.781074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.781211] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 is going to be created. [ 1012.803925] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.804807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.804807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.804807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.804807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.813342] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 in Status: UNINITIALIZED for 2s [ 1012.938245] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.938540] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.938608] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.938905] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.939072] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.939240] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port c8b37272-3a52-4265-b223-86ff61e17e4d not found, creating... [ 1012.939496] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.939663] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.939786] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.940349] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.940349] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.940527] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.940687] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.940810] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.941044] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.941267] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.941414] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: c8b37272-3a52-4265-b223-86ff61e17e4d is going to be created. [ 1012.960695] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.960888] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.961027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.961291] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.961526] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.961749] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.622324] env[64436]: INFO networking_nsxv3.common.synchronization [req-cb7e44ec-6754-4d74-ba40-0ac796e1bafb req-8f028130-5ce0-4295-847f-e61c13edf7dc service nova] Enqueued Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_rules [ 1013.622587] env[64436]: INFO networking_nsxv3.common.synchronization [req-cb7e44ec-6754-4d74-ba40-0ac796e1bafb req-8f028130-5ce0-4295-847f-e61c13edf7dc service nova] Enqueued Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_members [ 1013.622707] env[64436]: INFO networking_nsxv3.common.synchronization [req-cb7e44ec-6754-4d74-ba40-0ac796e1bafb req-8f028130-5ce0-4295-847f-e61c13edf7dc service nova] Enqueued Resource ID: c8b37272-3a52-4265-b223-86ff61e17e4d with Priority: HIGHEST for action port [ 1013.623284] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_rules [ 1013.623368] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_members [ 1013.623469] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b37272-3a52-4265-b223-86ff61e17e4d with Priority: HIGHEST for action port [ 1013.623743] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.623861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.623928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.624199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.624300] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.625069] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.625187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.625279] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.625455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.625603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.625699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.625783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.625902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.625985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.626085] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.626916] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8b37272-3a52-4265-b223-86ff61e17e4d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.627046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.627120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.627273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.627348] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8b37272-3a52-4265-b223-86ff61e17e4d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.129025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.129184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.129447] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.130390] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8b37272-3a52-4265-b223-86ff61e17e4d with status ACTIVE [ 1014.130568] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.130680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.130747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.130945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.131069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.131256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.131357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.131420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.131575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.131656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.131831] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.131923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.131986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.132149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.132246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.132359] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8b37272-3a52-4265-b223-86ff61e17e4d is going to be updated. [ 1014.152641] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.152836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.152836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.153115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.153291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.153521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8b37272-3a52-4265-b223-86ff61e17e4d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.634367] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.822443] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 in Status: SUCCESS [ 1014.822689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.822850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.823087] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.823282] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.823398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.823466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.823618] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.823701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.823794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.823875] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.137338] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.137533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.137604] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.137854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.137927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.137992] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 is going to be created. [ 1015.174121] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.174292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.174292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.174493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.174660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.185304] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 in Status: UNINITIALIZED for 2s [ 1015.325528] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.829167] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb56bfd6-0103-472c-bec4-cf6580a4f904: rpc.has_security_group_logging(os_id): False [ 1015.846672] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.846900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.846900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.847122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.847217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.847466] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.847570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.847636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.847790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.847868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.847993] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 is going to be created. [ 1015.905036] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.905206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.905206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.905511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.905712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.914753] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 in Status: IN_PROGRESS for 2s [ 1016.801219] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.801537] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.801763] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.802287] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.802636] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.802860] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.803039] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.803337] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.803554] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.803841] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.804025] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.804199] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.804377] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.804561] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.804760] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.804985] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.823778] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.823942] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.824139] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.824382] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-581" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.824719] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.824907] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.825492] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.826533] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.826724] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6bb360-4c5f-4be9-97ea-d80513dc0ea4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.197830] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 in Status: SUCCESS [ 1017.197830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.198100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.198129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.198300] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.198433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.198501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.198654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.198735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.198822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.198913] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.330593] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.330593] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.330770] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.332027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.332027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.332027] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.332027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.332027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.332325] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.332556] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.332961] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.333197] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.333367] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.333647] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.333833] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.334042] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 is going to be updated. [ 1017.374883] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.375335] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.375494] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.375790] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.376012] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.376268] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.703646] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.703646] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.703646] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.703646] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.703646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.704310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.704310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.704310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.704310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.704310] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.927064] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 in Status: SUCCESS [ 1017.927650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.189453] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.189719] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.189828] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.190137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.190418] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.190582] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.190703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.190946] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.191636] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.191997] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.192204] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.192375] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.192568] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.192743] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.192958] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.193190] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.208247] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0117c794-a2fb-459b-b43a-f26e5487cf02: rpc.has_security_group_logging(os_id): False [ 1018.212465] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.212465] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.212465] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.212465] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.212465] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-51b2ee16-4389-469c-b637-b792af4b3d7a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.212465] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.212755] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.213145] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.213356] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b2ee16-4389-469c-b637-b792af4b3d7a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.221266] env[64436]: INFO networking_nsxv3.common.synchronization [req-4d8ab30d-6128-4514-97bd-6ff4b5fb1312 req-fb8e28be-b233-4cec-8264-f3cb472692c9 service nova] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 1018.221266] env[64436]: INFO networking_nsxv3.common.synchronization [req-4d8ab30d-6128-4514-97bd-6ff4b5fb1312 req-fb8e28be-b233-4cec-8264-f3cb472692c9 service nova] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 1018.221266] env[64436]: INFO networking_nsxv3.common.synchronization [req-4d8ab30d-6128-4514-97bd-6ff4b5fb1312 req-fb8e28be-b233-4cec-8264-f3cb472692c9 service nova] Enqueued Resource ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 with Priority: HIGHEST for action port [ 1018.221266] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_rules [ 1018.221425] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 1018.221425] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 with Priority: HIGHEST for action port [ 1018.222355] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.222451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.222534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.222656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.223021] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.224208] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.224352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.224948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.225224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.225459] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.225603] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.225695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.225886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.226130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.226263] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.227075] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.227201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.227306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.227493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.227614] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6bb360-4c5f-4be9-97ea-d80513dc0ea4',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.229485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.229643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.229745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.229938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.230370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.230370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.230491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.230781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.230781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.230879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.231080] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.231227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.231322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.231511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.231632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.231848] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.231988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.232105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.232285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.232424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.232991] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 is going to be created. [ 1018.284566] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.284739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.284790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.285085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.285362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.294542] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 in Status: IN_PROGRESS for 2s [ 1018.715914] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.716231] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.716446] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.716774] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.716973] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.717198] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 51b2ee16-4389-469c-b637-b792af4b3d7a not found, creating... [ 1018.717498] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.717673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.717819] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.718117] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.718272] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.718673] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.718866] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.719089] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.719395] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.719660] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.719905] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 51b2ee16-4389-469c-b637-b792af4b3d7a is going to be created. [ 1018.729251] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.730109] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.730221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.734760] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 with status ACTIVE [ 1018.734955] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.735089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.735180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.735391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.735487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.735681] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.736454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.736454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.736454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.736454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.736454] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.736454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.736454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.736737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.736737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.736737] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d6bb360-4c5f-4be9-97ea-d80513dc0ea4 is going to be updated. [ 1018.738655] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.738837] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.738963] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.739204] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.739465] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.739676] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.760138] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.760138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.760138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.760284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.760510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.760680] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6bb360-4c5f-4be9-97ea-d80513dc0ea4" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.231670] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.436265] env[64436]: INFO networking_nsxv3.common.synchronization [req-f2cfb2ca-5ffe-4dc7-8dd6-8dfb1ad20038 req-679a77f7-7be8-40c7-9d73-f44600fe9abf service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 1019.436493] env[64436]: INFO networking_nsxv3.common.synchronization [req-f2cfb2ca-5ffe-4dc7-8dd6-8dfb1ad20038 req-679a77f7-7be8-40c7-9d73-f44600fe9abf service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 1019.436644] env[64436]: INFO networking_nsxv3.common.synchronization [req-f2cfb2ca-5ffe-4dc7-8dd6-8dfb1ad20038 req-679a77f7-7be8-40c7-9d73-f44600fe9abf service nova] Enqueued Resource ID: 51b2ee16-4389-469c-b637-b792af4b3d7a with Priority: HIGHEST for action port [ 1019.439295] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 1019.439488] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 1019.439579] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b2ee16-4389-469c-b637-b792af4b3d7a with Priority: HIGHEST for action port [ 1019.440398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.440518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.440592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.440786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.440869] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.444084] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.444171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.444204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.445110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.445283] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.445391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.445463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.448560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.448560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.448560] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.448560] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-51b2ee16-4389-469c-b637-b792af4b3d7a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.448560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.448560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.448560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.448801] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b2ee16-4389-469c-b637-b792af4b3d7a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.738117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.738117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.738117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.738117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.738117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.738117] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e is going to be updated. [ 1019.765531] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.766129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.766129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.766129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.766431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.774912] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: IN_PROGRESS for 2s [ 1019.951039] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.951684] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.951836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.951970] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51b2ee16-4389-469c-b637-b792af4b3d7a with status ACTIVE [ 1019.952220] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.952437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.952641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.952855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.952956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.953168] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.953281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.953360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.953543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.953619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.953815] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.953954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.953954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.954253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.954334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.954426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51b2ee16-4389-469c-b637-b792af4b3d7a is going to be updated. [ 1020.000849] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.000849] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.000936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.001188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.001363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.001602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.309545] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 in Status: SUCCESS [ 1020.309829] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.456455] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.961027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.961027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.961027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.961027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.961027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.961027] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 1020.985827] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.986037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.986037] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.986253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.986422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.997631] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 1021.786424] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: SUCCESS [ 1021.786699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.786914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.787223] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.787485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.787633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.787710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.787915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.788038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.788177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.788291] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.290901] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.732930] env[64436]: INFO networking_nsxv3.common.synchronization [req-df48329b-85f2-4af4-80a4-80f0a9316301 req-b4c46194-27c4-43a8-a3a9-45e4e7213eac tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1022.733458] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1022.733771] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.733900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.733967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.734196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.734424] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.734527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.734663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.734771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.734844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.734981] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.793238] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e: rpc.has_security_group_logging(os_id): False [ 1022.811953] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.812116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.812184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.812477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.830876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.830876] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.830876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.830876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.830876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.830876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.830876] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e is going to be updated. [ 1022.889044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.889044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.889044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.889440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.889539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.901536] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: IN_PROGRESS for 2s [ 1023.007170] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 1023.007450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.007589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.007807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.008061] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.008218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.008303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.008525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.008626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.008719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.008823] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.045027] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.045219] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.045304] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.045724] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.046030] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.046211] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.046337] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.046566] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.046718] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.046931] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.047065] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.047235] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.047292] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.047408] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.047519] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.047657] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.065726] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.065876] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1023.066041] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.066225] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.066542] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-2a1ad330-3d4b-4067-b271-002efee7db84 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.066722] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.066981] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.067221] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.067551] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a1ad330-3d4b-4067-b271-002efee7db84',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.238025] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.238282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.238804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.238804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.238804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.239081] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.239231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.239323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.239541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.239664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.239791] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1023.264645] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.264859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.264859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.265098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.265264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.273578] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1023.511934] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.511934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.511934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.512249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.512341] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.512565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.512650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.512836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.512919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.513034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.513170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.513276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.513333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.513481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.513620] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.513713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.513769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.513904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.513979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.514070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.514156] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.570389] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.571443] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.571443] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.571443] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.571610] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.571672] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 2a1ad330-3d4b-4067-b271-002efee7db84 not found, creating... [ 1023.571982] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.572167] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.572288] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.572514] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.572651] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.573040] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.573251] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.573411] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.574058] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.574058] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.574058] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 2a1ad330-3d4b-4067-b271-002efee7db84 is going to be created. [ 1023.593158] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.593395] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.593539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.593834] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.594096] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.594344] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.016724] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d226089-248b-47ba-bfe1-ba9fc67ca294: rpc.has_security_group_logging(os_id): False [ 1024.036402] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.036636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.036636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.036868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.037010] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.037236] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.037380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.037493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.037652] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.037771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.037990] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.038148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.038216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.038368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.038440] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.038682] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.038783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.038850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.038989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.039093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.039187] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 1024.096797] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.096988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.097043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.097240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.097405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.110399] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 1024.294593] env[64436]: INFO networking_nsxv3.common.synchronization [req-df48329b-85f2-4af4-80a4-80f0a9316301 req-92d4a459-006e-4540-8cb8-60f9e25dd193 service nova] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 1024.294811] env[64436]: INFO networking_nsxv3.common.synchronization [req-df48329b-85f2-4af4-80a4-80f0a9316301 req-92d4a459-006e-4540-8cb8-60f9e25dd193 service nova] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1024.295012] env[64436]: INFO networking_nsxv3.common.synchronization [req-df48329b-85f2-4af4-80a4-80f0a9316301 req-92d4a459-006e-4540-8cb8-60f9e25dd193 service nova] Enqueued Resource ID: 2a1ad330-3d4b-4067-b271-002efee7db84 with Priority: HIGHEST for action port [ 1024.295651] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 1024.295706] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1024.295879] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1ad330-3d4b-4067-b271-002efee7db84 with Priority: HIGHEST for action port [ 1024.296197] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.296368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.296449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.296610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.296713] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.298094] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.298267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.298420] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a1ad330-3d4b-4067-b271-002efee7db84 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.298545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.298654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.298866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.298947] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a1ad330-3d4b-4067-b271-002efee7db84',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.801241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.801445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.802852] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a1ad330-3d4b-4067-b271-002efee7db84 with status ACTIVE [ 1024.803065] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.803254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.803328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.803578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.803704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.803912] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.804063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.804132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.804307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.804433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.804644] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.804807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.804870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.805064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.805173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.805261] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a1ad330-3d4b-4067-b271-002efee7db84 is going to be updated. [ 1024.824829] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.824995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.825079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.825271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.825474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.825638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a1ad330-3d4b-4067-b271-002efee7db84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.921024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: SUCCESS [ 1024.921340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.286067] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1025.286342] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 deletion is rescheduled due to dependency. [ 1025.286377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.286584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.286862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.287085] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.287234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.287322] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.287499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.287607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.287724] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.789934] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.124290] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 1026.124622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.294068] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.795947] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.796219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.796341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.796638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.796772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.796921] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1026.826433] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.826662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.826785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.827074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.827291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.837405] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1027.881814] env[64436]: INFO networking_nsxv3.common.synchronization [req-1ba81d45-a71b-4eab-91a4-e6c8b5e21c04 req-7d488340-fcdb-4952-8f85-beb8a0b204ca tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1027.882299] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1027.882578] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.883458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.883458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.883458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.883458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.883458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.883458] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.883859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.883859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.883859] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.178156] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.178156] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.178156] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.178314] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.178913] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.179214] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.179365] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.179601] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.179756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.179974] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.180113] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.180263] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.180411] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.180634] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.180684] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.180811] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.200388] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.200594] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1028.200903] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.201099] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.201427] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-4125913c-0aad-4076-8ce9-6c028f5ff0a6 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.201616] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.201742] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.202062] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.202214] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4125913c-0aad-4076-8ce9-6c028f5ff0a6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.388302] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.704073] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.704345] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.704526] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.704855] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.705081] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.705434] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 4125913c-0aad-4076-8ce9-6c028f5ff0a6 not found, creating... [ 1028.705657] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.705865] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.706034] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.706270] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.706564] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.706699] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.706859] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.707013] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.707256] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.707408] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.707577] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 4125913c-0aad-4076-8ce9-6c028f5ff0a6 is going to be created. [ 1028.727158] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.727396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.727493] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.728385] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.728660] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.728902] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.848238] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1028.848518] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.848695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.848916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.849164] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.849312] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.849375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.849529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.849667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.849751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.849838] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.890997] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.353272] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.394265] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.394384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.394484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.394806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.394873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.395264] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1029.420351] env[64436]: INFO networking_nsxv3.common.synchronization [req-1ba81d45-a71b-4eab-91a4-e6c8b5e21c04 req-10865f27-f16d-436f-aaf5-b707d4794d21 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1029.420523] env[64436]: INFO networking_nsxv3.common.synchronization [req-1ba81d45-a71b-4eab-91a4-e6c8b5e21c04 req-10865f27-f16d-436f-aaf5-b707d4794d21 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1029.420668] env[64436]: INFO networking_nsxv3.common.synchronization [req-1ba81d45-a71b-4eab-91a4-e6c8b5e21c04 req-10865f27-f16d-436f-aaf5-b707d4794d21 service nova] Enqueued Resource ID: 4125913c-0aad-4076-8ce9-6c028f5ff0a6 with Priority: HIGHEST for action port [ 1029.420912] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1029.421095] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1029.421323] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4125913c-0aad-4076-8ce9-6c028f5ff0a6 with Priority: HIGHEST for action port [ 1029.423764] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.423893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.423964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.424197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.424361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.425806] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.426070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.426070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.426187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.426249] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.427071] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.427164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.427354] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4125913c-0aad-4076-8ce9-6c028f5ff0a6 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.431626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.431626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.431626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.431626] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4125913c-0aad-4076-8ce9-6c028f5ff0a6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.436188] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1029.856259] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0477e290-dfb6-401d-bc8e-f26e35953b43: rpc.has_security_group_logging(os_id): False [ 1029.877646] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.877858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.877858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.878201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.878352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.878627] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.878738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.878805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.878969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.879061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.879158] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1029.929656] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.930049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.930155] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4125913c-0aad-4076-8ce9-6c028f5ff0a6 with status ACTIVE [ 1029.930416] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.930530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.930599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.930799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.930888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.931064] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.931161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.931224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.931422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.931456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.931613] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.931706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.931780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.931897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.931973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.932062] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4125913c-0aad-4076-8ce9-6c028f5ff0a6 is going to be updated. [ 1029.945836] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.945984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.945984] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.946177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.946317] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.953568] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.953698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.953770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.953949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.954095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.954261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4125913c-0aad-4076-8ce9-6c028f5ff0a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.958705] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1030.052795] env[64436]: INFO networking_nsxv3.common.synchronization [req-41b4665a-02e8-4d70-8005-8d87e48395d6 req-a25678ab-c12f-4fee-a6e4-b88367f45b80 tempest-ServerPasswordTestJSON-649739366 tempest-ServerPasswordTestJSON-649739366-project-member] Enqueued Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_members [ 1030.053347] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGHEST for action security_group_members [ 1030.053652] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.053845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.053845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.054042] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.054198] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.054550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.054550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.054550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.054675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.054675] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.556845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.558138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.558235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.558497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.558635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.558851] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.558969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.559047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.559220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.559302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.559392] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 is going to be updated. [ 1030.587434] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.587587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.587667] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.587860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.587997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.606295] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 in Status: IN_PROGRESS for 2s [ 1031.446785] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1031.447121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.447250] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.447472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.447663] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.447781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1031.447848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.448018] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1031.448270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.448422] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.951511] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.973284] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1031.973533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.453845] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.618195] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 in Status: SUCCESS [ 1032.618476] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 deletion is rescheduled due to dependency. [ 1032.618674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.956136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.956220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.956220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.956503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.956614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.956718] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1032.987382] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.987553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.987681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.988257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.988345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.001658] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1035.012195] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.012195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.012195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.012195] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.054313] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1035.056519] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1035.516648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.516735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.517264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.517264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.517331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.517439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.517510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.517883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.518187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.518187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.518485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.518812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.518812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.518812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.518928] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.519045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.519889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.519889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.519889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.519889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.519889] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.809070] env[64436]: INFO networking_nsxv3.common.synchronization [req-37e54612-112d-4c73-9691-b88e0f83fe86 req-513a8777-3f87-4872-ab68-2f27a9d11498 tempest-DeleteServersTestJSON-2099407360 tempest-DeleteServersTestJSON-2099407360-project-member] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 1035.810449] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGHEST for action security_group_members [ 1035.810449] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.814492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.814492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.814492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.814492] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.814492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.814492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.814492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.814492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.814492] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.025862] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b396e974-2fce-4ce5-a60d-a8bc929e40e2: rpc.has_security_group_logging(os_id): False [ 1036.045727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.045933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.045933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.046229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.046300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.046449] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.046549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.046601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.046754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.046826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.047024] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.047232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.047232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.047305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.047541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.047602] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.047707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.047757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.047868] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.047939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.048034] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1036.112271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.112421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.112493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.113023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.113023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.127035] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1036.317827] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.317827] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.317827] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.317827] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be updated. [ 1036.345407] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.345407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.345407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.345407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.345407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.354103] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: IN_PROGRESS for 2s [ 1038.140279] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1038.141131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.363552] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f75433d-92b0-49c0-b145-a45f748925ab in Status: SUCCESS [ 1038.363738] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab deletion is rescheduled due to dependency. [ 1038.363853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.133730] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.133946] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.134095] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.134529] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.135051] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.135280] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.135443] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.135637] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.135788] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.136014] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.136138] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.136275] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.136414] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.136545] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.136659] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.136798] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.154782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.155069] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.155120] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.155260] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-303" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.155539] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-51b2ee16-4389-469c-b637-b792af4b3d7a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.155707] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.155829] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.156080] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.156224] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b2ee16-4389-469c-b637-b792af4b3d7a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.658144] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.658590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.658786] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.659129] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.659312] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.659675] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.659903] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.660015] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.660333] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.661603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.661603] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.661603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.661603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.661603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.661603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.661871] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 51b2ee16-4389-469c-b637-b792af4b3d7a is going to be updated. [ 1039.681014] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.681321] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.681517] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.681882] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.682200] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.682690] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.366817] env[64436]: INFO networking_nsxv3.common.synchronization [req-4dba19d3-2621-4804-8396-dd459d41c221 req-d04ee0b0-398e-42f3-997c-4148c53e009c service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 1040.367643] env[64436]: INFO networking_nsxv3.common.synchronization [req-4dba19d3-2621-4804-8396-dd459d41c221 req-d04ee0b0-398e-42f3-997c-4148c53e009c service nova] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 1040.367643] env[64436]: INFO networking_nsxv3.common.synchronization [req-4dba19d3-2621-4804-8396-dd459d41c221 req-d04ee0b0-398e-42f3-997c-4148c53e009c service nova] Enqueued Resource ID: 51b2ee16-4389-469c-b637-b792af4b3d7a with Priority: HIGHEST for action port [ 1040.367643] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_rules [ 1040.367643] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 1040.368189] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b2ee16-4389-469c-b637-b792af4b3d7a with Priority: HIGHEST for action port [ 1040.368394] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.369041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.369041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.369041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.369041] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.370132] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.370332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.370387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.371103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.371103] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.371103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.371103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.371103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.371370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.371370] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.371975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-51b2ee16-4389-469c-b637-b792af4b3d7a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.372095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.372162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.372313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.372389] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b2ee16-4389-469c-b637-b792af4b3d7a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.877021] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.877021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.877021] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51b2ee16-4389-469c-b637-b792af4b3d7a with status ACTIVE [ 1040.877021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.877021] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.877021] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.877522] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.877522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.877522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.877522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.877522] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.877969] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51b2ee16-4389-469c-b637-b792af4b3d7a is going to be updated. [ 1040.902182] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.905177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.905177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.905177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.905177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.905177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51b2ee16-4389-469c-b637-b792af4b3d7a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.096276] env[64436]: INFO networking_nsxv3.common.synchronization [req-b671a3e1-8eea-492a-88b0-4ed6a7a5bc8a req-13870787-8edb-40a3-a86c-a01f2f829d2b tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1041.096786] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1041.097669] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.097669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.097669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.097669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.097669] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.097946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.097946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.097946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.098034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.098061] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.384555] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.600474] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.887310] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.887310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.887310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.887555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.887653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.887755] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 1041.918015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.918157] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.918238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.918468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.918613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.929534] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 1042.102272] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.605026] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.605405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1042.605405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.605488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1042.605580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1042.605675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1042.634040] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.634040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1042.634040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.634268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1042.634447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1042.643112] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1043.941896] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 1043.941896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.941896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.941896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.941896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.942332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.942332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.942332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.942332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.942528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.942528] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.444671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.444832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.444832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.445043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.445214] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.445321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.445387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.445545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.445633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.445721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.445867] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.445957] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.446032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.446173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.446305] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.446395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.446457] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.446586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.446657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.446736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.446819] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.651825] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1044.652054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.951923] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d226089-248b-47ba-bfe1-ba9fc67ca294: rpc.has_security_group_logging(os_id): False [ 1044.969606] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.969758] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.969833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.970065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.970160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.970426] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.970537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.970601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.970754] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.970830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.971048] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.971144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.971240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.971338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.971412] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.971600] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.971692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.972101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.972101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.972101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.972503] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 1045.034993] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.035168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.035242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.035557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.035736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.049609] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 1046.098486] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1046.098733] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1047.065904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 1047.066154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.099778] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1051.100172] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1052.815405] env[64436]: INFO networking_nsxv3.common.synchronization [req-d530f188-b1ce-44d7-983a-06cd7a40f812 req-449d3820-517c-4ef7-a832-a937fdca51c0 tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1052.815405] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1052.815699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.815811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.815875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.816085] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.816240] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.816339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.816425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.816544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.816627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.816717] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.318741] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.318902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.318958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.319195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.340930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.341197] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.341314] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.341398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.341622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.341693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.341776] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 1053.367103] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.367299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.367360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.367566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.367752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.375640] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 1055.387217] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 1055.387606] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a deletion is rescheduled due to dependency. [ 1055.387606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.091661] env[64436]: INFO networking_nsxv3.common.synchronization [req-ba0515d6-c579-4fac-8b87-5deb4b1ccd3f req-4eaf17f5-fe4d-409c-a2a0-753b3edf3c93 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 1056.094380] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 1056.094380] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.094380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.094380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.094380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.094380] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.094380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.094380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.094380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.094380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.094380] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.451235] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f87a57c-2e73-4e31-9a81-e7ea9803f498 req-bd9500c2-b4c0-40aa-9ff8-5fb28a4ab924 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1056.451752] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1056.452292] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.452444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.454573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.454573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.454573] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.454573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.454573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.454573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.454573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.454573] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.598152] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.744603] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.744603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.744603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.744603] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.744832] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.744889] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.745019] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.745243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.745396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.745611] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.745728] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.745843] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.745956] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.746099] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.746265] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.746327] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.764598] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.764789] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.764993] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.765206] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.765555] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-4d326927-d31d-49d9-a19a-e7f70b5f035a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.765739] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.765869] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.766181] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.766329] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d326927-d31d-49d9-a19a-e7f70b5f035a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.956651] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.100913] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.268939] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.269159] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.269288] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.269585] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.269746] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.269904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 4d326927-d31d-49d9-a19a-e7f70b5f035a not found, creating... [ 1057.270184] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.270347] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.270526] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.270749] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.270904] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.271210] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.271381] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.271504] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.271713] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.271851] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.271992] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 4d326927-d31d-49d9-a19a-e7f70b5f035a is going to be created. [ 1057.289817] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.289990] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.290128] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.290348] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.290639] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.290853] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.459738] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.602946] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.603149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.603256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.603517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.603617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.603726] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be updated. [ 1057.633525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.633726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.633767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.633952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.634115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.644428] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: IN_PROGRESS for 2s [ 1057.962764] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.962764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.962884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.963090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.963172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.963275] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1058.006650] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.006877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.006952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.007351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.007351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.015772] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1058.453286] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f87a57c-2e73-4e31-9a81-e7ea9803f498 req-31dfbb1e-4970-44f1-9231-7dded2fa1e5c service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1058.453351] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f87a57c-2e73-4e31-9a81-e7ea9803f498 req-31dfbb1e-4970-44f1-9231-7dded2fa1e5c service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1058.453542] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f87a57c-2e73-4e31-9a81-e7ea9803f498 req-31dfbb1e-4970-44f1-9231-7dded2fa1e5c service nova] Enqueued Resource ID: 4d326927-d31d-49d9-a19a-e7f70b5f035a with Priority: HIGHEST for action port [ 1058.453822] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1058.453978] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1058.454110] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d326927-d31d-49d9-a19a-e7f70b5f035a with Priority: HIGHEST for action port [ 1058.454683] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.454836] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.454945] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.455199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.455311] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.456128] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.456227] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.456418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d326927-d31d-49d9-a19a-e7f70b5f035a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.456519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.456584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.456748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.456820] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d326927-d31d-49d9-a19a-e7f70b5f035a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.958526] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d326927-d31d-49d9-a19a-e7f70b5f035a with status ACTIVE [ 1058.958789] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.959165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.959165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.959238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.959340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.959480] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.959589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.959651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.959805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.959881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.960129] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.960181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.960244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.960671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.960671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.960671] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d326927-d31d-49d9-a19a-e7f70b5f035a is going to be updated. [ 1058.961696] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.961786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.980589] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.980724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1058.980793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.980979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1058.981126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1058.981275] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d326927-d31d-49d9-a19a-e7f70b5f035a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.653922] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 1059.654164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.025207] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1060.025486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.025967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.025967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.025967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.026148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.026185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.026316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.026399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.026492] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.528365] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.031230] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.459937] env[64436]: INFO networking_nsxv3.common.synchronization [req-61ef61da-b977-4244-96e5-cb2c00908c36 req-ca0cf1d8-ebc7-4b1f-9a6a-96d688cac4da tempest-AttachVolumeTestJSON-1026812064 tempest-AttachVolumeTestJSON-1026812064-project-member] Enqueued Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_members [ 1061.460684] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee94a361-ec26-4356-a9e8-dacb252b81bb with Priority: HIGHEST for action security_group_members [ 1061.461141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee94a361-ec26-4356-a9e8-dacb252b81bb taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.461270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.461326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.461581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.461794] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.461935] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.462034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.462211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.462300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.462395] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee94a361-ec26-4356-a9e8-dacb252b81bb',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.534028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.534218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.534303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.534495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.534587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.534696] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1061.562046] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.562208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.562267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.562478] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.562661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.574009] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1061.964763] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.964763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.964763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.964943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.965050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.965259] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.965360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.965425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.965617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.965666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.965782] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee94a361-ec26-4356-a9e8-dacb252b81bb is going to be updated. [ 1062.005065] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.005252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.005252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.005450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.005591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.013969] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee94a361-ec26-4356-a9e8-dacb252b81bb in Status: IN_PROGRESS for 2s [ 1063.582599] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1063.582986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.583061] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.583235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.583426] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.583544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.583600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.583748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.583832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.583916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.584015] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.612521] env[64436]: INFO networking_nsxv3.common.synchronization [req-b55fcc14-8ba0-4c98-a78a-7dff5a3e0cf8 req-f473e090-f760-4cb0-be9d-f037ea019202 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 1063.612521] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGHEST for action security_group_members [ 1063.612521] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.612521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.612521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.612521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.612789] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.612789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.612862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.614187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.614187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.614187] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.742768] env[64436]: INFO networking_nsxv3.common.synchronization [req-55ff6494-c1f9-4893-af5d-38e1dd26520b req-3fc330a3-dc56-4a45-b201-23d1ffa24572 tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1063.743408] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1063.743725] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.743848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.743907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.744144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.744309] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.744414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.744472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.744650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.744727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.744891] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.023440] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee94a361-ec26-4356-a9e8-dacb252b81bb in Status: SUCCESS [ 1064.024064] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee94a361-ec26-4356-a9e8-dacb252b81bb deletion is rescheduled due to dependency. [ 1064.024064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee94a361-ec26-4356-a9e8-dacb252b81bb" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.038763] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.038763] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.038763] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.038763] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.039051] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.039228] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.039418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.039654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.039809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.040037] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.040160] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.040279] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.040393] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.040573] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.040735] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.040889] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.058757] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.058927] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.059080] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.059267] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.059597] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-e0c843e6-bb25-4a69-b065-bdd362a84c01 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.059771] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.059891] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.060261] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.060403] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c843e6-bb25-4a69-b065-bdd362a84c01',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.086657] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.087121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.087121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.087417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.087603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.087773] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.087956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.088124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.088258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.088404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.088653] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.088837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.088926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.089145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.089368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.089523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.089626] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.089845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.089977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.090125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.090263] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.120202] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.120431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.120431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.120713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.120819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.121019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.121152] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.121216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.121362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.121517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.121587] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be updated. [ 1064.147879] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.148140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.148258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.148583] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.148820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.156987] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: IN_PROGRESS for 2s [ 1064.247586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.247781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.247821] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.248185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.248297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.248575] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.248715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.248817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.249031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.249106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.249155] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 1064.272828] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.273088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.273194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.273428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.273570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.282566] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 1064.563163] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.563408] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.563547] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.563905] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.564090] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.564256] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port e0c843e6-bb25-4a69-b065-bdd362a84c01 not found, creating... [ 1064.564525] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.564746] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.564832] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.565081] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.565242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.565536] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.565703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.565824] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.566073] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.566205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.566364] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 is going to be created. [ 1064.584957] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.585264] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.585308] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.585587] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.585828] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.586081] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.594081] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b396e974-2fce-4ce5-a60d-a8bc929e40e2: rpc.has_security_group_logging(os_id): False [ 1064.609267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.609468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.609515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.610072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.610072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.610072] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.610215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.610215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.610323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.610409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.610653] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.610746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.610822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.610948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.611045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.611243] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.611339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.611402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.611567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.611645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.611734] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1064.685869] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.686036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.686182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.686313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.686465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.708143] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1065.280537] env[64436]: INFO networking_nsxv3.common.synchronization [req-55ff6494-c1f9-4893-af5d-38e1dd26520b req-edce1ae2-96d6-49ac-aaa2-024d7855f677 service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 1065.282277] env[64436]: INFO networking_nsxv3.common.synchronization [req-55ff6494-c1f9-4893-af5d-38e1dd26520b req-edce1ae2-96d6-49ac-aaa2-024d7855f677 service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1065.282277] env[64436]: INFO networking_nsxv3.common.synchronization [req-55ff6494-c1f9-4893-af5d-38e1dd26520b req-edce1ae2-96d6-49ac-aaa2-024d7855f677 service nova] Enqueued Resource ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 with Priority: HIGHEST for action port [ 1065.282277] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 1065.282688] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1065.282992] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 with Priority: HIGHEST for action port [ 1065.283142] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.283310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.284706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.284706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.284706] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.285072] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.285191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.285589] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0c843e6-bb25-4a69-b065-bdd362a84c01 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.285589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.285589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.285972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.286119] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c843e6-bb25-4a69-b065-bdd362a84c01',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.788844] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0c843e6-bb25-4a69-b065-bdd362a84c01 with status ACTIVE [ 1065.789148] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.789288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.789373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.789609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.789715] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.789967] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.790084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.790159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.790323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.790411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.790678] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.790796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.790859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.791294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.791294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.791294] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 is going to be updated. [ 1065.792528] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.792689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.810845] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.811211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.811211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.811616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.811749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.812629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.165408] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b271b036-4ee8-48b7-9a6a-455fa62def61 in Status: SUCCESS [ 1066.165665] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 deletion is rescheduled due to dependency. [ 1066.165815] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.291633] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 1066.291848] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a deletion is rescheduled due to dependency. [ 1066.291979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.292148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.292391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.292585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.292705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.292772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.292951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.293089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.293205] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.720693] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1066.720989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.795656] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.299486] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.801067] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.801482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.801482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.801578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.801651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.801783] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 1067.827114] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.827114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.827114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.827419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.827556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.835142] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 1067.877115] env[64436]: INFO networking_nsxv3.common.synchronization [None req-c8e045e4-6264-46b7-b6ac-09fe4c395e00 tempest-AttachInterfacesTestJSON-577193443 tempest-AttachInterfacesTestJSON-577193443-project-member] Enqueued Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 1067.877843] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 with Priority: HIGHEST for action security_group_members [ 1067.877996] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d226089-248b-47ba-bfe1-ba9fc67ca294 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.878095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.878163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.878356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.878527] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.878632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.878694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.878840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.878937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.879048] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d226089-248b-47ba-bfe1-ba9fc67ca294',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.381580] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.381869] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.381977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.382142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.382243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.382428] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.382526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.382589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.382825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.382950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.383025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 is going to be updated. [ 1068.409876] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.410084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.410084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.410293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.410434] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.419586] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: IN_PROGRESS for 2s [ 1069.844463] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 1069.844759] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.844839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.845062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.845896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.845896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.845896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.845896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.845896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.845896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.845896] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.348964] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.428907] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 in Status: SUCCESS [ 1070.428907] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d226089-248b-47ba-bfe1-ba9fc67ca294 deletion is rescheduled due to dependency. [ 1070.429229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d226089-248b-47ba-bfe1-ba9fc67ca294" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.854309] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4df507f-e3c4-414d-8e32-1d9e119b190a: rpc.has_security_group_logging(os_id): False [ 1070.870938] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.870938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.870938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.870938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.870938] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.871271] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.871271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.871352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.871444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.871625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.871680] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 1070.925696] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.925985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.925985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.926137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.926264] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.948642] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 1072.272284] env[64436]: INFO networking_nsxv3.common.synchronization [None req-9022cd1d-29ad-48fb-9ba9-119341b58dd6 None None] Enqueued Resource ID: 67045583-3eff-484d-b41a-dcf20269b477 with Priority: HIGHEST for action port [ 1072.278135] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67045583-3eff-484d-b41a-dcf20269b477 with Priority: HIGHEST for action port [ 1072.278825] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-67045583-3eff-484d-b41a-dcf20269b477 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.278960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67045583-3eff-484d-b41a-dcf20269b477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.279045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67045583-3eff-484d-b41a-dcf20269b477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.279320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67045583-3eff-484d-b41a-dcf20269b477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.279404] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67045583-3eff-484d-b41a-dcf20269b477',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.782152] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67045583-3eff-484d-b41a-dcf20269b477 [ 1072.782403] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.782539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.782613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.782871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.782981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.783082] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67045583-3eff-484d-b41a-dcf20269b477 already deleted. [ 1072.783134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67045583-3eff-484d-b41a-dcf20269b477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.962287] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 1072.962513] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.142726] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d5bb43c7-ac34-41d4-81ac-44dbf9b58111 None None] Enqueued Resource ID: 7ae33c08-9909-4711-b76e-53358e8f8667 with Priority: HIGHEST for action port [ 1074.143026] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae33c08-9909-4711-b76e-53358e8f8667 with Priority: HIGHEST for action port [ 1074.143589] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ae33c08-9909-4711-b76e-53358e8f8667 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.143716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ae33c08-9909-4711-b76e-53358e8f8667" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.144470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ae33c08-9909-4711-b76e-53358e8f8667" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.144470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ae33c08-9909-4711-b76e-53358e8f8667" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.144470] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ae33c08-9909-4711-b76e-53358e8f8667',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.649164] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ae33c08-9909-4711-b76e-53358e8f8667 [ 1074.649509] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.649765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.649860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.650115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.650251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.650392] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ae33c08-9909-4711-b76e-53358e8f8667 already deleted. [ 1074.650510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ae33c08-9909-4711-b76e-53358e8f8667" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.852935] env[64436]: INFO networking_nsxv3.common.synchronization [req-2baf0419-87d7-410a-9d8a-d3ff48b7436c req-c4d9f826-a5bc-47fc-849d-20527e06a1d3 tempest-AttachVolumeShelveTestJSON-1255090841 tempest-AttachVolumeShelveTestJSON-1255090841-project-member] Enqueued Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 1074.853477] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e with Priority: HIGHEST for action security_group_members [ 1074.853788] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.853910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.853973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.854211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.854368] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.854480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.854554] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.854709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.854794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.854883] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.357434] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.357739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.357739] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.357905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.357981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.358223] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.358329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.358393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.358561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.358633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.358720] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e is going to be updated. [ 1075.395315] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.395511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.395550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.395735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.395884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.407324] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: IN_PROGRESS for 2s [ 1075.653130] env[64436]: INFO networking_nsxv3.common.synchronization [req-93f41672-2772-42e9-8ba0-fe711eac0992 req-d1545a5f-9830-46a5-bfb5-9b91df36bdcb tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1075.653698] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1075.654049] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.654209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.654299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.654515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.654691] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.654812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.654888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.655069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.655179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.655286] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.110721] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.111028] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.111170] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.111444] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.111716] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.113585] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.113585] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.113585] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.113585] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.113585] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.113585] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.113585] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.113585] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.113585] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1076.113585] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.114138] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.131941] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.132126] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1076.132272] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.132449] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.132747] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d1a5cac1-468f-4e02-b39f-d51679633601 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.132933] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.133083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.133385] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.133528] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1a5cac1-468f-4e02-b39f-d51679633601',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.156603] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.635488] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.635880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.635880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.636138] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.636297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.636456] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d1a5cac1-468f-4e02-b39f-d51679633601 not found, creating... [ 1076.636711] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.636879] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.637012] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.637251] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.637396] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.637717] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.637899] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.638036] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.638253] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.638843] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.638843] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d1a5cac1-468f-4e02-b39f-d51679633601 is going to be created. [ 1076.659344] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.659581] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.659692] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.659977] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.660233] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.660466] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.665381] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.168493] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.168738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.168828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.169031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.169132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.169246] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1077.198245] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.198413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.198857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.198857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.199230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.208693] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1077.394935] env[64436]: INFO networking_nsxv3.common.synchronization [req-93f41672-2772-42e9-8ba0-fe711eac0992 req-cfb2906d-abfc-4d9e-9699-bb8064c667b0 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1077.395145] env[64436]: INFO networking_nsxv3.common.synchronization [req-93f41672-2772-42e9-8ba0-fe711eac0992 req-cfb2906d-abfc-4d9e-9699-bb8064c667b0 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1077.395278] env[64436]: INFO networking_nsxv3.common.synchronization [req-93f41672-2772-42e9-8ba0-fe711eac0992 req-cfb2906d-abfc-4d9e-9699-bb8064c667b0 service nova] Enqueued Resource ID: d1a5cac1-468f-4e02-b39f-d51679633601 with Priority: HIGHEST for action port [ 1077.395500] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1077.395641] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1077.395742] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1a5cac1-468f-4e02-b39f-d51679633601 with Priority: HIGHEST for action port [ 1077.397851] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.397851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.397851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.397851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.397851] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.398670] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.398788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.398964] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1a5cac1-468f-4e02-b39f-d51679633601 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.399076] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.399145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.399315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.399389] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1a5cac1-468f-4e02-b39f-d51679633601',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.419239] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e in Status: SUCCESS [ 1077.419239] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e deletion is rescheduled due to dependency. [ 1077.419239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.901751] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.902089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.902132] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1a5cac1-468f-4e02-b39f-d51679633601 with status ACTIVE [ 1077.902300] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.902409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.902475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.902692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.902785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.902980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.903054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.903117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.903272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.903349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.903524] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.903616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.903676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.903810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.903882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.903961] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1a5cac1-468f-4e02-b39f-d51679633601 is going to be updated. [ 1077.925028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.925191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.925263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.925462] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.925596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.925998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1a5cac1-468f-4e02-b39f-d51679633601" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.218071] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1079.218071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.218071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.218527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.218527] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.218619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.218665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.218808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.218892] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.218983] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.721404] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.223354] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.726081] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.726081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.726081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.726081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.726404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.726404] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1080.752820] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.753022] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.753067] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.753267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.753410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.761974] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1081.326333] env[64436]: INFO networking_nsxv3.common.synchronization [req-b32f972c-7c99-420d-95f8-295c362dfa7b req-856b44fb-decb-4fb0-81c8-9cfb21cfa094 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1081.327050] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1081.327227] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.327353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.327430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.327763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.327956] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.328102] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.328191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.328392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.328508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.328681] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.831753] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.831965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.832054] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.832226] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.832934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.832934] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.832934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.832934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.832934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.832934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.833257] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 already deleted. [ 1081.833257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.873572] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.873777] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.873909] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.874271] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.874807] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.874807] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.875236] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.875236] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.875236] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.875502] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.875502] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.875656] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.875707] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.875816] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.875917] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.876064] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.892704] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.892878] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.893020] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.893203] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.893505] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b5e5a243-fa15-43d9-a463-9f2e76739e58 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.893675] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.893799] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.894130] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.894274] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5e5a243-fa15-43d9-a463-9f2e76739e58',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.397906] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.398313] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.398313] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.398455] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.399415] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.399415] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b5e5a243-fa15-43d9-a463-9f2e76739e58 not found, creating... [ 1082.399415] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.399415] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.399672] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.401824] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.402886] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.402886] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.402886] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.402886] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.402886] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.403373] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.403373] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b5e5a243-fa15-43d9-a463-9f2e76739e58 is going to be created. [ 1082.423525] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.423745] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.423880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.424177] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.424415] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.424640] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.771139] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1082.771368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.771502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.771729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.771947] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.772096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.772159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.772272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.772352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.772437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.772526] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.128829] env[64436]: INFO networking_nsxv3.common.synchronization [req-b32f972c-7c99-420d-95f8-295c362dfa7b req-1a38a7c7-186d-4269-85b9-9fd75a345e0b service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1083.129023] env[64436]: INFO networking_nsxv3.common.synchronization [req-b32f972c-7c99-420d-95f8-295c362dfa7b req-1a38a7c7-186d-4269-85b9-9fd75a345e0b service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1083.129171] env[64436]: INFO networking_nsxv3.common.synchronization [req-b32f972c-7c99-420d-95f8-295c362dfa7b req-1a38a7c7-186d-4269-85b9-9fd75a345e0b service nova] Enqueued Resource ID: b5e5a243-fa15-43d9-a463-9f2e76739e58 with Priority: HIGHEST for action port [ 1083.129402] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1083.129533] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1083.129627] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e5a243-fa15-43d9-a463-9f2e76739e58 with Priority: HIGHEST for action port [ 1083.132136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.132273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.132351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.132609] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.132760] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.133699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.133819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.133887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.134154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.134309] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.134455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.134537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.134706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.134818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.134933] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.136376] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5e5a243-fa15-43d9-a463-9f2e76739e58 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.136501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.136571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.136735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.136860] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5e5a243-fa15-43d9-a463-9f2e76739e58',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.274370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.274572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.274572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.274763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.274932] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.275050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.275117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.275278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.275367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.275455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.275605] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.275697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.275760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.275902] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.276051] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.276153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.276248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.276446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.276527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.276612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.276702] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.638575] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.640821] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.641331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.641331] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5e5a243-fa15-43d9-a463-9f2e76739e58 with status ACTIVE [ 1083.641407] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.641502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.641549] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.641749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.641850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.642047] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.642150] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.642267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.642390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.642570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.642802] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.642909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.642971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.643127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.643205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.643290] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5e5a243-fa15-43d9-a463-9f2e76739e58 is going to be updated. [ 1083.665115] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.665316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.665350] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.665535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.665671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.665866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5e5a243-fa15-43d9-a463-9f2e76739e58" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.778688] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b396e974-2fce-4ce5-a60d-a8bc929e40e2: rpc.has_security_group_logging(os_id): False [ 1083.803253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.803564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.803564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.803694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.803778] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.803955] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.804066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.804122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.804270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.804339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.804527] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.804611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.804690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.804812] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.804885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.805116] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.805213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.805281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.805413] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.805488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.805577] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1083.860683] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.860898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.860898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.861100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.861280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.877012] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1084.141167] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.644098] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.644390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.644390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.644473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.644505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.644599] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be created. [ 1084.667923] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.668086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.668086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.668377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.668427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.677390] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: UNINITIALIZED for 2s [ 1085.891967] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1085.892267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.686705] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1086.686907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.687107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.687326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.687531] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.687649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.687718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.687887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.687967] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.688077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.688166] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.190608] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.190987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.191128] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.191481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.191698] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.191807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.191874] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.192064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.192178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.192396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.192616] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.192799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.192977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.193124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.193384] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.193529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.193591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.193832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.194026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.194202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.194329] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.485310] env[64436]: INFO networking_nsxv3.common.synchronization [req-e53bca8a-d8f4-4583-a200-6261338bdd33 req-7e336cec-a07f-44e1-a9c3-d5e6a8b4560c tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1087.486030] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1087.486221] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.486323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.486382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.487954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.487954] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.487954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.487954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.487954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.487954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.487954] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.697897] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70eef184-9328-4455-90b8-5dfd198676b9: rpc.has_security_group_logging(os_id): False [ 1087.713822] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.713979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.714034] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.714240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.714332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.714562] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.714656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.714737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.714896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.714975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.715176] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.715274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.715337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.715474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.715548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.715743] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.715811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.715880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.716040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.716116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.716201] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be created. [ 1087.768299] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.768461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.768506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.768807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.769030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.779925] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1087.989885] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.491828] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.994272] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.995218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1088.995218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.995218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1088.995218] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1088.995218] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1089.025386] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.025539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1089.025613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.025789] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1089.025998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.033820] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1089.796836] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1089.797235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.043426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1091.043426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.337742] env[64436]: INFO networking_nsxv3.common.synchronization [req-9ffe1859-fc17-43b5-bb25-fdee6096e973 req-689d1edf-3ee0-421d-9884-becde1240a94 tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_members [ 1091.337889] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGHEST for action security_group_members [ 1091.338457] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.339525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.339525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.339525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.339525] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.339525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.339525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.339525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.339525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.340070] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.847652] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.847894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.847894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.848149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.848249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.848456] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.848558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.848614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.848777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.848970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.849089] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f is going to be updated. [ 1091.874791] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.875205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.875205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.875278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.875569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.883649] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: IN_PROGRESS for 2s [ 1093.894583] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f in Status: SUCCESS [ 1093.894990] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f deletion is rescheduled due to dependency. [ 1093.894990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.352849] env[64436]: INFO networking_nsxv3.common.synchronization [req-3d49a5af-a173-425a-9ebb-8e807256b5ce req-266c3e9b-fb3b-41f0-82ae-ca1e6a2206e7 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1095.353285] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1095.353628] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.353732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.353796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.353992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.354162] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.356123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.356123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.356123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.356123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.356123] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.856998] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.362491] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.865823] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.866079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.866206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.866455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.866559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.866629] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1096.895855] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.896255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.896365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.896625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.896866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.907648] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1097.034506] env[64436]: INFO networking_nsxv3.common.synchronization [None req-119f78f6-e0c3-4a24-9523-7faf3a546062 None None] Enqueued Resource ID: 4a666cb8-9cad-4124-b7fe-8765fb460958 with Priority: HIGHEST for action port [ 1097.034506] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a666cb8-9cad-4124-b7fe-8765fb460958 with Priority: HIGHEST for action port [ 1097.034986] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a666cb8-9cad-4124-b7fe-8765fb460958 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.035095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a666cb8-9cad-4124-b7fe-8765fb460958" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.035095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a666cb8-9cad-4124-b7fe-8765fb460958" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.035345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a666cb8-9cad-4124-b7fe-8765fb460958" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.035430] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a666cb8-9cad-4124-b7fe-8765fb460958',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.537560] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a666cb8-9cad-4124-b7fe-8765fb460958 [ 1097.537822] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.537959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.538060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.538294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.538390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.538484] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a666cb8-9cad-4124-b7fe-8765fb460958 already deleted. [ 1097.538588] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a666cb8-9cad-4124-b7fe-8765fb460958" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.654387] env[64436]: INFO networking_nsxv3.common.synchronization [None req-4f96ddd9-56b4-471a-a877-38e9fcfd4ded tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_rules [ 1097.654969] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_rules [ 1097.655331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.655483] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.655587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.655872] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.655986] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.728486] env[64436]: INFO networking_nsxv3.common.synchronization [None req-4987340a-33d8-4370-b30d-28a027aff317 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_rules [ 1097.728996] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_rules [ 1097.729395] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.729506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.175424] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.175572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.175572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.175855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.175933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.175967] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff already deleted. [ 1098.176066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.176210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.176713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.176713] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.696365] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.696679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1098.696679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.696785] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1098.696867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.696962] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff already deleted. [ 1098.697116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1098.917918] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1098.918340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.463097] env[64436]: INFO networking_nsxv3.common.synchronization [None req-cac5309a-5d3e-432c-bb82-8db514b0e17c None None] Enqueued Resource ID: 168dce39-1669-4088-bf6f-15a7874089af with Priority: HIGHEST for action port [ 1099.463097] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168dce39-1669-4088-bf6f-15a7874089af with Priority: HIGHEST for action port [ 1099.463321] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-168dce39-1669-4088-bf6f-15a7874089af taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.463473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-168dce39-1669-4088-bf6f-15a7874089af" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.463564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-168dce39-1669-4088-bf6f-15a7874089af" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.463860] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-168dce39-1669-4088-bf6f-15a7874089af" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.463946] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('168dce39-1669-4088-bf6f-15a7874089af',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.966118] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 168dce39-1669-4088-bf6f-15a7874089af [ 1099.966412] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.966529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.966599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.966937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.967072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.967177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:168dce39-1669-4088-bf6f-15a7874089af already deleted. [ 1099.967261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-168dce39-1669-4088-bf6f-15a7874089af" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.622706] env[64436]: INFO networking_nsxv3.common.synchronization [req-e11f76ab-951b-47b9-996f-76b60d0cab25 req-89684e71-2bb4-4752-a881-9fc768f5d651 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1102.623363] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1102.623677] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.623828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.623921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.624145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.624499] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.624499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.624499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.624668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.624668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.624750] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.127486] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.127638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.127678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.127895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.127990] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.128230] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.128334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.128397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.128552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.128630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.128718] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1103.154682] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.154851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.154851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.155055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.155193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.163044] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1105.173763] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1105.174269] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1105.174269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.337065] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f70609e-57b1-4b62-aa01-80f8757b128e req-63e672fd-e3d6-46b8-ba7e-8b0a95f65410 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_members [ 1105.337922] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_members [ 1105.337922] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.338035] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.338070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.338319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.338476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.338579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.338642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.338817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.338910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.339470] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.749754] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.750165] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.750165] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.750446] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.750712] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.750903] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.751045] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.751284] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.751439] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.751655] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.751770] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.751902] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.752032] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.752152] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.752263] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.752507] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.769480] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.769642] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.769920] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.770136] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.770428] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-024cf3cf-9193-487c-af07-6c8af1319cbf taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.770596] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.770717] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.771196] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.771358] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('024cf3cf-9193-487c-af07-6c8af1319cbf',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.786566] env[64436]: INFO networking_nsxv3.common.synchronization [req-6330bd73-6a15-4ed4-b203-7cda3eca6aa5 req-86541aa6-5d64-4864-8952-5f2ae8ecd77c tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 1105.787289] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 1105.787588] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.787706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.787776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.787987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.788158] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.788257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.788321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.788474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.788560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.788651] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.841433] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.841658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.841751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.841979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.842086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.842285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.842386] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.842448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.842699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.842699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.842794] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff already deleted. [ 1105.842826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.274440] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.274805] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.274805] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.275092] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.275278] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.275461] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 024cf3cf-9193-487c-af07-6c8af1319cbf not found, creating... [ 1106.275762] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.275964] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.276114] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.276342] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.276487] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.276770] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.276932] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.277103] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.277326] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.277464] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.277606] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 024cf3cf-9193-487c-af07-6c8af1319cbf is going to be created. [ 1106.290213] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.295868] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.296071] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.296206] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.296445] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.296684] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.296909] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.792399] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.977708] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f70609e-57b1-4b62-aa01-80f8757b128e req-291b7afe-d9ce-4623-afa8-02c26edb8af7 service nova] Enqueued Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_rules [ 1106.977936] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f70609e-57b1-4b62-aa01-80f8757b128e req-291b7afe-d9ce-4623-afa8-02c26edb8af7 service nova] Enqueued Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_members [ 1106.979266] env[64436]: INFO networking_nsxv3.common.synchronization [req-3f70609e-57b1-4b62-aa01-80f8757b128e req-291b7afe-d9ce-4623-afa8-02c26edb8af7 service nova] Enqueued Resource ID: 024cf3cf-9193-487c-af07-6c8af1319cbf with Priority: HIGHEST for action port [ 1106.979832] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_rules [ 1106.979970] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_members [ 1106.980084] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 024cf3cf-9193-487c-af07-6c8af1319cbf with Priority: HIGHEST for action port [ 1106.980370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.980570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.980570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.980747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.980855] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.981727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.981876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.981952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.982141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.982289] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.982383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.982446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.982587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.982672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.982759] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.983478] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-024cf3cf-9193-487c-af07-6c8af1319cbf taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.983587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.983656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.983885] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.983885] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('024cf3cf-9193-487c-af07-6c8af1319cbf',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.296116] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.296116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.296116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.296116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.296116] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.296116] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be updated. [ 1107.323099] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.323248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.323319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.323648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.323648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.331411] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: IN_PROGRESS for 2s [ 1107.486246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.486246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.486438] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.487283] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 024cf3cf-9193-487c-af07-6c8af1319cbf with status ACTIVE [ 1107.487458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.487572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.487629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.487833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.487921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.488104] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.488202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.488263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.488414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.492078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.492078] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.492078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.492078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.492078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.492078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.492078] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 024cf3cf-9193-487c-af07-6c8af1319cbf is going to be updated. [ 1107.521558] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.521558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.521742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.521832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.521976] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.522145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-024cf3cf-9193-487c-af07-6c8af1319cbf" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.533452] env[64436]: INFO networking_nsxv3.common.synchronization [req-d9f6f603-012e-4aeb-b658-c224395a7d01 req-d8ce8ce5-f11c-4be3-9782-996c58d7dbfc tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1107.534024] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1107.534369] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.534521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.534596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.534813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.534993] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.535127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.535196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.535380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.535492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.535588] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.817544] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.817755] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.817885] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.818186] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.818451] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.818615] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.818736] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.818977] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.819143] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.819358] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.819476] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.819589] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.819705] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.819838] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.819954] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.820114] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.854212] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.854212] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.854212] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.854212] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.854212] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-b0595563-7b50-4290-9ed3-3ef84c08e307 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.854212] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.854212] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.854212] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.854212] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0595563-7b50-4290-9ed3-3ef84c08e307',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.992068] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.038467] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.038599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.039689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.039689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.039689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.039689] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.039689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.039689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.039689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.039689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.039689] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1108.064957] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.065104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.065104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.065316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.065455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.073508] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1108.357114] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.357114] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.357518] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.357518] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.357587] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.357746] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port b0595563-7b50-4290-9ed3-3ef84c08e307 not found, creating... [ 1108.358010] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.358184] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.358309] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.358531] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.358673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.359021] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.359192] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.359320] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.359533] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.359673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.359854] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: b0595563-7b50-4290-9ed3-3ef84c08e307 is going to be created. [ 1108.379107] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.379325] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.379509] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.379770] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.380052] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.380318] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.494159] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.494354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.494417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.494631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.494723] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.494826] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff is going to be created. [ 1108.530606] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.530792] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.530916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.531130] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.531295] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.540958] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff in Status: UNINITIALIZED for 2s [ 1109.080262] env[64436]: INFO networking_nsxv3.common.synchronization [req-d9f6f603-012e-4aeb-b658-c224395a7d01 req-6e8b0152-29c1-4e54-ae47-f2d09ac21d84 service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1109.080262] env[64436]: INFO networking_nsxv3.common.synchronization [req-d9f6f603-012e-4aeb-b658-c224395a7d01 req-6e8b0152-29c1-4e54-ae47-f2d09ac21d84 service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1109.080262] env[64436]: INFO networking_nsxv3.common.synchronization [req-d9f6f603-012e-4aeb-b658-c224395a7d01 req-6e8b0152-29c1-4e54-ae47-f2d09ac21d84 service nova] Enqueued Resource ID: b0595563-7b50-4290-9ed3-3ef84c08e307 with Priority: HIGHEST for action port [ 1109.080741] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1109.080741] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1109.080741] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0595563-7b50-4290-9ed3-3ef84c08e307 with Priority: HIGHEST for action port [ 1109.081088] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.081291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.082421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.082421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.082421] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.082768] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.082893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.083176] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0595563-7b50-4290-9ed3-3ef84c08e307 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.083353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.083450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.083671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.083773] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0595563-7b50-4290-9ed3-3ef84c08e307',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.341557] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 1109.341774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.586128] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.586688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.586688] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0595563-7b50-4290-9ed3-3ef84c08e307 with status ACTIVE [ 1109.586688] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.587072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.587072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.587072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.587211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.587306] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.587403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.587721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.587721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.587721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.587906] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.588020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.588082] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.588228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.588290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.588374] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0595563-7b50-4290-9ed3-3ef84c08e307 is going to be updated. [ 1109.607101] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.607248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.607307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.607490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.607623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.607780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0595563-7b50-4290-9ed3-3ef84c08e307" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.740687] env[64436]: INFO networking_nsxv3.common.synchronization [req-47815204-1477-45c7-93bd-bf8430919ce3 req-c3c8740d-8892-48e0-a241-6b0425c98a30 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1109.741368] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1109.741580] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.741701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.741786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.742040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.742235] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.742347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.742410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.742574] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.742704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.742811] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.038688] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.038990] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.039149] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.039423] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.039690] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.039856] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.039995] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.040255] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.040402] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.040618] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.040737] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.040912] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.041046] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.041168] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.041285] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.041438] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.059348] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.059492] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.059629] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.059799] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.060436] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-625dca93-f86f-412f-a248-b314a3ce76b8 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.060436] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.060436] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.060664] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.060805] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('625dca93-f86f-412f-a248-b314a3ce76b8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.082533] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1110.082700] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1110.082808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.082952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.083166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.083362] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.083475] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.083541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.083689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.083767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.083856] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.245058] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.551402] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff in Status: SUCCESS [ 1110.551581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.551742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.551988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.552195] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.552315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.552379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.552533] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.552629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.552698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.552780] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.563122] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.563372] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.563498] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.563765] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.563931] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.564128] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 625dca93-f86f-412f-a248-b314a3ce76b8 not found, creating... [ 1110.564400] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.564564] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.564721] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.564906] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.565120] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.565368] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.565539] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.565663] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.565875] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.566038] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.566186] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 625dca93-f86f-412f-a248-b314a3ce76b8 is going to be created. [ 1110.586945] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.586945] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.586945] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.586945] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.586945] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.587352] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.588231] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.746951] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.054888] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.090387] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.250581] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.250747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.250819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.251110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.251209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.251335] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1111.280167] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.280311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.280384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.280631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.280783] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.290044] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1111.294655] env[64436]: INFO networking_nsxv3.common.synchronization [req-47815204-1477-45c7-93bd-bf8430919ce3 req-60424add-3454-4a8a-aed0-0c2b7cda8558 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1111.294844] env[64436]: INFO networking_nsxv3.common.synchronization [req-47815204-1477-45c7-93bd-bf8430919ce3 req-60424add-3454-4a8a-aed0-0c2b7cda8558 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1111.294984] env[64436]: INFO networking_nsxv3.common.synchronization [req-47815204-1477-45c7-93bd-bf8430919ce3 req-60424add-3454-4a8a-aed0-0c2b7cda8558 service nova] Enqueued Resource ID: 625dca93-f86f-412f-a248-b314a3ce76b8 with Priority: HIGHEST for action port [ 1111.295228] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1111.295355] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1111.295449] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 625dca93-f86f-412f-a248-b314a3ce76b8 with Priority: HIGHEST for action port [ 1111.296044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.296268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.296337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.296546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.296625] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.297422] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.297562] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.298019] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-625dca93-f86f-412f-a248-b314a3ce76b8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.298138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.298202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.298365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.298440] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('625dca93-f86f-412f-a248-b314a3ce76b8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.558949] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff: rpc.has_security_group_logging(os_id): False [ 1111.581085] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.581303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.581303] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.581516] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.581616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.581872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.581983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.582110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.582276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.582358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.582450] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff is going to be created. [ 1111.597020] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.597020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.597020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.597020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.597020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.597020] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1111.637820] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.638032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.638118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.638349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.638494] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.651198] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1111.669072] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.669072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.669072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.669072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.669072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.680373] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff in Status: IN_PROGRESS for 2s [ 1111.800975] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 625dca93-f86f-412f-a248-b314a3ce76b8 with status ACTIVE [ 1111.800975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.800975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.800975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.801229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.801262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.801451] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.801553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.801616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.801768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.801847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.802042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.802139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.802200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.802341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.802415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.802498] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 625dca93-f86f-412f-a248-b314a3ce76b8 is going to be updated. [ 1111.803638] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.803752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.824938] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.825088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.825134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.825316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.825486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.825695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-625dca93-f86f-412f-a248-b314a3ce76b8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.856531] env[64436]: INFO networking_nsxv3.common.synchronization [req-16bf5b13-f07c-496c-b316-ac0fa712fdf8 req-0e7adb44-e1f2-403a-8412-5c23caaf3fb2 tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1112.857215] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1112.857215] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.857409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.857409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.857630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.857699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.857796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.857937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.858115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.858228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.858453] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.300191] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1113.300410] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.300573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.300799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.301035] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.301154] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.301231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.301395] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.301491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.301572] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.360074] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.360311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.360406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.361160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.361160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.361160] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.361160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.361160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.361439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.361439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.361439] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1113.390203] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.390804] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.390934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.391193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.391398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.399725] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1113.661410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1113.661649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.661810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.662077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.662270] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.662388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.662454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.662611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.662690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.662776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.662864] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.690421] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff in Status: SUCCESS [ 1113.690639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.803720] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.165504] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.165980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.165980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.165980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.166204] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.166287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.166345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.166484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.166665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.166665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.166852] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.166971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.166971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.167129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.167268] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.167360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.167421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.167556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.167633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.167714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.167804] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.306049] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.670189] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70eef184-9328-4455-90b8-5dfd198676b9: rpc.has_security_group_logging(os_id): False [ 1114.687923] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.688104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.688177] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.688381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.688645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.688685] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.688777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.688840] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.688982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.689071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.689251] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.689344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.689406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.689541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.689612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.689781] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.689871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.689932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.690098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.690173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.690257] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1114.749180] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.749320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.749430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.749586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.749729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.761242] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1114.808066] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.808210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.808292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.808542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.809115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.809115] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1114.863903] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.864133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.864243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.864560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.864699] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.874804] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1115.413113] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1115.415106] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 deletion is rescheduled due to dependency. [ 1115.415106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.024179] env[64436]: INFO networking_nsxv3.common.synchronization [req-d5002ad8-ea6e-4136-8f45-e7ef0f225b3d req-9e44660e-7be5-4961-beb3-d48fe0c76373 tempest-ServerRescueNegativeTestJSON-951003550 tempest-ServerRescueNegativeTestJSON-951003550-project-member] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 1116.026766] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGHEST for action security_group_members [ 1116.027180] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.028044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.028044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.028044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.028044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.028311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.028311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.028719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.028719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.028719] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.531120] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.531467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.531467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.531605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.531695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.531908] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.532092] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.532159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.532320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.532398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.532488] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be updated. [ 1116.561834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.562107] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.562213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.562421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.562569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.570796] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: IN_PROGRESS for 2s [ 1116.774065] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1116.774311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.884138] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1116.884364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.884545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.884763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.885263] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.885263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.885263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.885467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.885467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.885467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.885544] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.388829] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.389065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.389145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.389383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.389560] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.389666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.389725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.389878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.389969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.390072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.390258] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.390359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.390425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.390564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.390700] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.390800] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.391142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.391142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.391142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.391285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.391372] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.848573] env[64436]: INFO networking_nsxv3.common.synchronization [req-540060f2-f6ef-4ff6-b1a1-64434a342a86 req-acd1d591-2dc1-4e6c-9a2c-f6e9e12f91af tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_members [ 1117.849288] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGHEST for action security_group_members [ 1117.849515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.849692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.849735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.849964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.850288] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.850417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.850541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.850707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.850813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.851042] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.893566] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b396e974-2fce-4ce5-a60d-a8bc929e40e2: rpc.has_security_group_logging(os_id): False [ 1117.912987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.913339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.913414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.913623] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.913786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.914103] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.914304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.914417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.914691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.914820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.915109] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.915286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.915405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.915586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.915690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.916340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.916340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.916340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.916340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.916340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.916559] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1117.983381] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.983541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.983617] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.983833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.983986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.996340] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1118.353146] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.353276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.353355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.353578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.353674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.353871] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.353973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.354046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.354204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.354282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.354370] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 is going to be updated. [ 1118.379921] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.380071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.380143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.380334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.380467] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.388714] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 in Status: IN_PROGRESS for 2s [ 1118.583515] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 in Status: SUCCESS [ 1118.583844] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 deletion is rescheduled due to dependency. [ 1118.584046] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.010322] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1120.011127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.419775] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 in Status: SUCCESS [ 1120.419891] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 deletion is rescheduled due to dependency. [ 1120.420011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.438061] env[64436]: INFO networking_nsxv3.common.synchronization [req-446327aa-a917-4659-8e64-6f0040889939 req-bd4221e3-78cf-40eb-b124-4041a36f133e tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1120.438658] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1120.439063] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.439169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.439435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.439435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.439567] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.439787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.439787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.444063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.444234] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.444346] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.718346] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.718559] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.718694] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.718981] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.719257] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.719422] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.719545] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.719762] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.719915] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.720144] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.720266] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.720569] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.720569] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.720704] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.720781] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.721024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.739113] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.739328] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1120.739398] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.739544] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-720" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.741250] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.741250] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.741250] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.741250] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.741250] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6db29241-6c0e-4e0e-a29a-40d97e1d8fe9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.950674] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.950837] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.950988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.951356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.951457] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.951676] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.951807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.951876] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.952206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.952299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.952396] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1120.977067] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.977288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.977330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.977521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.977664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.985545] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1121.245055] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.245055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.245055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.245055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.245055] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.245678] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 not found, creating... [ 1121.245678] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.245778] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.245828] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.246071] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.246220] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.246531] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.246744] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.246892] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.247160] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.247334] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.247537] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 is going to be created. [ 1121.267548] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.267820] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.267917] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.268197] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.268453] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.268703] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.980220] env[64436]: INFO networking_nsxv3.common.synchronization [req-446327aa-a917-4659-8e64-6f0040889939 req-fa5d6b2e-8df4-4fe7-a431-9168aa1bac8c service nova] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 1121.980405] env[64436]: INFO networking_nsxv3.common.synchronization [req-446327aa-a917-4659-8e64-6f0040889939 req-fa5d6b2e-8df4-4fe7-a431-9168aa1bac8c service nova] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1121.980549] env[64436]: INFO networking_nsxv3.common.synchronization [req-446327aa-a917-4659-8e64-6f0040889939 req-fa5d6b2e-8df4-4fe7-a431-9168aa1bac8c service nova] Enqueued Resource ID: 6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 with Priority: HIGHEST for action port [ 1121.980860] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_rules [ 1121.980924] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1121.981023] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 with Priority: HIGHEST for action port [ 1121.981621] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.981705] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.981760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.981960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.984383] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.986241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.986241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.986241] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.986241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.986241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.986241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.986241] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6db29241-6c0e-4e0e-a29a-40d97e1d8fe9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.487548] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.487850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.487905] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 with status ACTIVE [ 1122.488119] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.488254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.488373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.488558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.488656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.488872] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.489026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.489093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.489432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.489432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.489545] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.489643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.489707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.489843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.489928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.490584] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6db29241-6c0e-4e0e-a29a-40d97e1d8fe9 is going to be updated. [ 1122.511708] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.511888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.512091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.512161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.512300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.512465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6db29241-6c0e-4e0e-a29a-40d97e1d8fe9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.802712] env[64436]: INFO networking_nsxv3.common.synchronization [req-489b227d-db14-448a-bd2d-13f653892caa req-c6f671d3-3fb4-4cf1-b502-5e60a30b1832 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1122.803354] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1122.804359] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.804359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.804359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.804721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.804721] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.804721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.805586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.805586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.805586] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.805586] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.996066] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1122.996348] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 deletion is rescheduled due to dependency. [ 1122.996659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.996659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.996846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.997048] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.997230] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.997286] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.997581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.997581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.997668] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.307620] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.499894] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.810913] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.002245] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.315027] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.315027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.315027] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.315337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.315337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.315431] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1124.341822] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.342141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.342141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.342291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.342396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.350857] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1124.504700] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.505043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.505043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.505149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.505243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.505341] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1124.534493] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.534493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1124.534493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.534493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1124.534493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.541166] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1126.362425] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1126.362795] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.551667] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1126.551925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.552120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.552377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.552577] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.552697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1126.552764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.552951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1126.553020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.553114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1126.553207] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.056045] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.558574] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0477e290-dfb6-401d-bc8e-f26e35953b43: rpc.has_security_group_logging(os_id): False [ 1127.575735] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.575953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.575953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.576173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.576269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.576552] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.576655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.576726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.576875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.576953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.577072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1127.654088] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.654308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.654308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.654502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.654650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.665274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1127.804089] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.804276] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1129.151451] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa4563a8-9bd4-4624-821c-a04fc0cd3c4a req-c77c2881-4055-4633-8e78-7b322a99f2ac tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 1129.151845] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 1129.152289] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.152447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.152525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.152730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.152911] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.153031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.153108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.153293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.153399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.153575] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.429469] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.429469] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.429469] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.429469] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.429815] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.430011] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.430209] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.430506] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.430921] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.431028] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.431205] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.431369] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.431531] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.431696] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.431854] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.432059] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.451995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.451995] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.452182] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.452221] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.452509] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.452679] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.452805] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.453124] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.453271] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a12f173-f25c-4d30-b272-7fa7ddffdd1a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.655428] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.655531] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.655663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.655822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.655916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.656136] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.656239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.656763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.656763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.656763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.656763] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be updated. [ 1129.688674] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1129.688929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.694522] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.694665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.694720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.694914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.695086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.703596] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: IN_PROGRESS for 2s [ 1129.955532] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.955738] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.955830] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.956147] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.956311] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.956477] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 2a12f173-f25c-4d30-b272-7fa7ddffdd1a not found, creating... [ 1129.956761] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.957017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.957090] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.957299] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.957447] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.957737] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.957901] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.958083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.958318] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.958462] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.958612] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 2a12f173-f25c-4d30-b272-7fa7ddffdd1a is going to be created. [ 1129.988577] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.988954] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1129.989100] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.989538] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1129.989890] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1129.990216] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.675844] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa4563a8-9bd4-4624-821c-a04fc0cd3c4a req-5a87120d-b13e-4db9-b624-f2561b4b0560 service nova] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_rules [ 1130.676186] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa4563a8-9bd4-4624-821c-a04fc0cd3c4a req-5a87120d-b13e-4db9-b624-f2561b4b0560 service nova] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 1130.676186] env[64436]: INFO networking_nsxv3.common.synchronization [req-fa4563a8-9bd4-4624-821c-a04fc0cd3c4a req-5a87120d-b13e-4db9-b624-f2561b4b0560 service nova] Enqueued Resource ID: 2a12f173-f25c-4d30-b272-7fa7ddffdd1a with Priority: HIGHEST for action port [ 1130.678028] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_rules [ 1130.678028] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 1130.678028] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12f173-f25c-4d30-b272-7fa7ddffdd1a with Priority: HIGHEST for action port [ 1130.678336] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.678552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.678648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.678940] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.679042] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.680010] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.680169] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.680479] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.680654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.680750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.680988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.681126] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a12f173-f25c-4d30-b272-7fa7ddffdd1a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.182631] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.182826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.182962] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a12f173-f25c-4d30-b272-7fa7ddffdd1a with status ACTIVE [ 1131.183155] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.183278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.183388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.183687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.183784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.183976] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.184125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.184211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.184367] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.184443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.184627] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.184734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.184794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.184905] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.184969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.185069] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a12f173-f25c-4d30-b272-7fa7ddffdd1a is going to be updated. [ 1131.207141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.207302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.207342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.207717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.207864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.208058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.399959] env[64436]: INFO networking_nsxv3.common.synchronization [req-ba8f2527-3390-4d68-acf9-eea9b0b4372c req-93277b84-4c88-4007-817f-51209dcd91ac tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1131.401289] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1131.401289] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.401289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.401289] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.401481] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.401543] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.401595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.401668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.401824] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.401912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.402016] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.713950] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 1131.714351] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c deletion is rescheduled due to dependency. [ 1131.714351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.714550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.714848] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.715127] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.715285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.715371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.715601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.715712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.715850] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.904011] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.904323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.904438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.904666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.904761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.905050] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.905170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.905231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.905451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.905535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.905629] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1131.930266] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.930455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.930455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.930695] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.930891] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.939814] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1132.218506] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.382706] env[64436]: INFO networking_nsxv3.common.synchronization [req-5bd00213-72e0-4fab-9973-a743a9d8fd24 req-63e27d0f-7275-4723-970b-4f6d69e6d4ef tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1132.382764] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1132.383041] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.383193] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.383249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.383454] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.383573] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.383687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.383750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.383916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.384103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.384241] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.659811] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.660025] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.660179] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.660521] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.662137] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.662137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.662137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.662137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.662137] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.662137] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.662137] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.662137] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.662137] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.662612] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.662612] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.662612] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.681233] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.681452] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.681639] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.681839] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-239" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.682407] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-98548c6f-c274-4b02-af8f-35beed1cf34b taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.682552] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.682639] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.682978] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.683144] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98548c6f-c274-4b02-af8f-35beed1cf34b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.721055] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.886313] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.186100] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.186299] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.186434] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.186828] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.186969] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.187216] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 98548c6f-c274-4b02-af8f-35beed1cf34b not found, creating... [ 1133.187605] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.187838] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.189281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.189281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.189281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.189281] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.189281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.189281] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.189678] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.189678] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.189855] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 98548c6f-c274-4b02-af8f-35beed1cf34b is going to be created. [ 1133.213091] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.213285] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.213413] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.213654] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.213883] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.214125] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.222666] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.222786] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.222828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.222996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.223091] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.223179] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be updated. [ 1133.250085] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.250283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.250392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.250704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.250859] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.258662] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: IN_PROGRESS for 2s [ 1133.388414] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.868409] env[64436]: INFO networking_nsxv3.common.synchronization [req-5bd00213-72e0-4fab-9973-a743a9d8fd24 req-35567de4-9c2c-4bbf-bbc8-3d5ef4fc4440 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1133.868642] env[64436]: INFO networking_nsxv3.common.synchronization [req-5bd00213-72e0-4fab-9973-a743a9d8fd24 req-35567de4-9c2c-4bbf-bbc8-3d5ef4fc4440 service nova] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1133.868712] env[64436]: INFO networking_nsxv3.common.synchronization [req-5bd00213-72e0-4fab-9973-a743a9d8fd24 req-35567de4-9c2c-4bbf-bbc8-3d5ef4fc4440 service nova] Enqueued Resource ID: 98548c6f-c274-4b02-af8f-35beed1cf34b with Priority: HIGHEST for action port [ 1133.868941] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_rules [ 1133.869103] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1133.869211] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98548c6f-c274-4b02-af8f-35beed1cf34b with Priority: HIGHEST for action port [ 1133.869758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.869909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.869944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.870474] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.870589] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.871969] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.872237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.872699] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-98548c6f-c274-4b02-af8f-35beed1cf34b taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.872857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.872952] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.873251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.873360] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98548c6f-c274-4b02-af8f-35beed1cf34b',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.894381] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.894521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.895689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.895689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.895689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.895689] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1133.923174] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.923291] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.923382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.923543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.923684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.932437] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1133.947393] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1133.947559] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1133.947672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.373691] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.373691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.378213] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98548c6f-c274-4b02-af8f-35beed1cf34b with status ACTIVE [ 1134.378213] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.378213] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.378213] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.378213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.378213] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98548c6f-c274-4b02-af8f-35beed1cf34b is going to be updated. [ 1134.397339] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.397339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.397339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.397339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.397339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.397339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98548c6f-c274-4b02-af8f-35beed1cf34b" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.700226] env[64436]: INFO networking_nsxv3.common.synchronization [req-7fad08d7-3391-4005-8a14-f0545dfd94ba req-02a0ecd7-1885-48ee-9d20-a9042a4307e6 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1134.700919] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1134.703032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.703032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.703032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.703032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.703032] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.703032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.703032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.703032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.703032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.703032] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.095978] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.096307] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.096469] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.096742] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.097015] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.097185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.097310] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.097815] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.098036] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.098263] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.099479] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.099479] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.099479] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.099479] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.099479] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.099479] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.115917] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.116094] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.118317] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.118317] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.118317] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.118317] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.118317] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.118317] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.118317] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.204705] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.204871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.204914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.205148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.205240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.205437] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.205535] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.205599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.205752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.205828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.205916] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1135.234543] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.234691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.234755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.234909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.235063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.242987] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1135.266157] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 1135.266344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.266493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.266669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.266838] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.266944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.267016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.267170] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.267251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.267334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.267423] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.620303] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.620527] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.620661] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.621106] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.621297] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.621463] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 not found, creating... [ 1135.621722] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.621985] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.622180] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.622427] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.622575] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.622862] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.623114] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.623242] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.623473] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.623617] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.623761] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 is going to be created. [ 1135.642453] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.642685] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.642816] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.643099] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.643370] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.643624] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.769947] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.770135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.770197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.770426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.770598] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.770698] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.770765] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.770974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.771045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.771183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.771414] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.771534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.771598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.771746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.771888] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.771983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.772066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.772272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.772353] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.772435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.772532] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.943231] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1135.943527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.943787] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.944144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.944350] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.944480] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.944551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.944718] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.944802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.944898] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.276054] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e217869-d443-46d3-8722-54105951b88c: rpc.has_security_group_logging(os_id): False [ 1136.293738] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.293887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.293963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.294213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.294313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.294538] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.294643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.294709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.294864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.294942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.295142] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.295241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.295307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.295445] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.295521] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.295697] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.295794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.295855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.295991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.296079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.296166] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be updated. [ 1136.332513] env[64436]: INFO networking_nsxv3.common.synchronization [req-7fad08d7-3391-4005-8a14-f0545dfd94ba req-bfd2c19d-bcd8-4104-a533-6efd434a0a0a service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1136.332687] env[64436]: INFO networking_nsxv3.common.synchronization [req-7fad08d7-3391-4005-8a14-f0545dfd94ba req-bfd2c19d-bcd8-4104-a533-6efd434a0a0a service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1136.332848] env[64436]: INFO networking_nsxv3.common.synchronization [req-7fad08d7-3391-4005-8a14-f0545dfd94ba req-bfd2c19d-bcd8-4104-a533-6efd434a0a0a service nova] Enqueued Resource ID: 8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 with Priority: HIGHEST for action port [ 1136.333055] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1136.333179] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1136.333270] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 with Priority: HIGHEST for action port [ 1136.333825] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.333999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.333999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.334214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.334288] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.335092] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.335205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.335364] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.335457] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.335517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.335664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.335731] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.350995] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.351373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.351373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.351463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.351534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.365198] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: IN_PROGRESS for 2s [ 1136.447531] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.837496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.837685] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.837901] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 with status ACTIVE [ 1136.838155] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.838369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.838427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.838663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.838777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.839544] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.839544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.839544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.839544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.839544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.839980] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.839980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.839980] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.840220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.840220] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.840336] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93 is going to be updated. [ 1136.860033] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.860033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.860033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.860033] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.860278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.860278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dc1735c-49b5-4e9f-9d4b-eb9f5177fb93" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.949898] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.253077] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1137.253077] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1137.253077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.253077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.253273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.253456] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.253565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.253631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.253781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.253863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.253965] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.452482] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.452851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.452851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.452851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.453043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.453089] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1137.478958] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.479180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.479180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.479330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.479471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.488054] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1137.756548] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.258980] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.385509] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 1138.385788] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.763274] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.763274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.763274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.763274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.763274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.763274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1138.790031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.790031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.790213] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.790406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.790600] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.799114] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1139.497645] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1139.497873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.498058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.498280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.498681] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.498817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.498886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.499090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.499191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.499281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.499373] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.001343] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.001689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.001689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.001784] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.001932] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.002045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.002112] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.002267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.002356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.002446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.002595] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.002688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.002749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.002893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.003059] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.003126] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.003187] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.003323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.003402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.003482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.003569] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.223563] env[64436]: INFO networking_nsxv3.common.synchronization [req-3550c5ab-0ac8-44ea-82bf-53e563e8c3a0 req-fa30a11d-261c-4c33-bdbc-5c3b9e0dd8bc tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 1140.223563] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGHEST for action security_group_members [ 1140.223563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.223563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.223563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.223563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.223563] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.223793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.223793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.224050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.224124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.224201] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.260466] env[64436]: INFO networking_nsxv3.common.synchronization [req-3550c5ab-0ac8-44ea-82bf-53e563e8c3a0 req-fa30a11d-261c-4c33-bdbc-5c3b9e0dd8bc tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 2a12f173-f25c-4d30-b272-7fa7ddffdd1a with Priority: HIGHEST for action port [ 1140.260930] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a12f173-f25c-4d30-b272-7fa7ddffdd1a with Priority: HIGHEST for action port [ 1140.261323] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.261442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.261560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.261688] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.261765] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a12f173-f25c-4d30-b272-7fa7ddffdd1a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.505747] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b396e974-2fce-4ce5-a60d-a8bc929e40e2: rpc.has_security_group_logging(os_id): False [ 1140.524140] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.524283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.524357] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.524877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.524877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.524988] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.525097] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.525161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.525335] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.525431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.525629] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.525744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.525814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.525994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.526075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.526298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.526402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.526479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.526627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.526713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.526809] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1140.587387] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.587572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.587659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.587894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.588080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.602426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1140.726157] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.726365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.726463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.726690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.726782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.727015] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.727156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.727255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.727484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.727598] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.727714] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be updated. [ 1140.764157] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a12f173-f25c-4d30-b272-7fa7ddffdd1a with status ACTIVE [ 1140.764390] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.764525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.764595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.764805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.764898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.765097] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.765205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.765267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.765415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.765491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.765671] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.765764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.765823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.765979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.766068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.766154] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a12f173-f25c-4d30-b272-7fa7ddffdd1a is going to be updated. [ 1140.767912] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.768036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.768108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.768262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.768390] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.778036] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: IN_PROGRESS for 2s [ 1140.794643] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.794843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.794843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.795063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.795202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.795361] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a12f173-f25c-4d30-b272-7fa7ddffdd1a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.808274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1140.808498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.808666] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.808881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.809135] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.809266] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.809331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.809499] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.809587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.809668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.809757] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.313602] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.313602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.313602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.314108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.314108] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.314108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.314108] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.314262] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.314352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.314441] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.314598] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.314684] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.314745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.314886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.315042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.315124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.315191] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.315377] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.315460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.315541] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.315660] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.817691] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70eef184-9328-4455-90b8-5dfd198676b9: rpc.has_security_group_logging(os_id): False [ 1141.837648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.837830] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.837878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.838442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.838442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.838442] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.838620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.838620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.838831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.838831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.838981] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.839131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.839196] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.839340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.839427] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.839603] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.839748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.839794] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.839897] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.839969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.840072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1141.894339] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.894514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.894558] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.894752] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.894899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1141.908346] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1142.617134] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1142.617443] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.787167] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e217869-d443-46d3-8722-54105951b88c in Status: SUCCESS [ 1142.787284] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e217869-d443-46d3-8722-54105951b88c deletion is rescheduled due to dependency. [ 1142.787401] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.885888] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.886104] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.886249] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.886521] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.886784] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.886950] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.887220] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.887490] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.887645] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.888159] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.888159] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.888159] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.888314] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.888314] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1142.888430] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.888567] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.906810] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.906976] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1142.907133] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.907309] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-363" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.907592] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-e0c843e6-bb25-4a69-b065-bdd362a84c01 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.907757] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.907879] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.908139] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.908282] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c843e6-bb25-4a69-b065-bdd362a84c01',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.411175] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.411667] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.411929] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.412439] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.412745] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.413470] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.413701] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.413941] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.414426] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.414762] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.415244] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.415568] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.415756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.416190] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.416503] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.416777] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 is going to be updated. [ 1143.438678] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.439313] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.439561] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.440063] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.440491] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.440880] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.937431] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1143.937431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.138673] env[64436]: INFO networking_nsxv3.common.synchronization [req-56400c09-6eda-412c-bf09-73fd0eefc6b2 req-5258cd63-4661-4db8-93d0-522e1993eafd service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 1144.138921] env[64436]: INFO networking_nsxv3.common.synchronization [req-56400c09-6eda-412c-bf09-73fd0eefc6b2 req-5258cd63-4661-4db8-93d0-522e1993eafd service nova] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1144.139215] env[64436]: INFO networking_nsxv3.common.synchronization [req-56400c09-6eda-412c-bf09-73fd0eefc6b2 req-5258cd63-4661-4db8-93d0-522e1993eafd service nova] Enqueued Resource ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 with Priority: HIGHEST for action port [ 1144.139478] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_rules [ 1144.139655] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1144.139811] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 with Priority: HIGHEST for action port [ 1144.140393] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.140523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.140590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.140791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.140874] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.141752] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.141863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.141934] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.142109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.142255] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.142370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.142437] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.142546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.142632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.142720] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.143465] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0c843e6-bb25-4a69-b065-bdd362a84c01 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.143548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.143602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.143736] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.143809] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c843e6-bb25-4a69-b065-bdd362a84c01',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.645778] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.645909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.646123] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0c843e6-bb25-4a69-b065-bdd362a84c01 with status ACTIVE [ 1144.646302] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.646409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.646471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.646675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.646764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.646931] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.647038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.647100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.647260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.647339] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.647513] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.647606] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.647660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.647797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.647870] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.647952] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0c843e6-bb25-4a69-b065-bdd362a84c01 is going to be updated. [ 1144.649020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.668749] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.668912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.668912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.669139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.669306] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.669472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0c843e6-bb25-4a69-b065-bdd362a84c01" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.151286] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.654215] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.654491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.654491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.654727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.654850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.654979] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 1145.692324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.692575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.692575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.692729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.692887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.703631] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 1146.693031] env[64436]: INFO networking_nsxv3.common.synchronization [req-7dc0b09a-9fbd-48c4-815f-0b1f154a3e0e req-b99c7783-8b2b-4584-b58c-6328d304eef8 tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1146.693586] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1146.693894] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.694039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.694125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.694362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.694523] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.694633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.694731] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.694956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.695077] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.695250] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.196956] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.699864] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.713360] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 1147.713570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.713725] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.713941] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.714143] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.714261] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.714332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.714485] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.714563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.714647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.714733] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.202780] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.203106] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.203344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.203657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.203772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.203906] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1148.216945] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.232267] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.232267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.232267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.232267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.232267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.240797] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1148.719189] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4df507f-e3c4-414d-8e32-1d9e119b190a: rpc.has_security_group_logging(os_id): False [ 1148.736480] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.736627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.736692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.736907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.736998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.737360] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.737479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.737479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.737735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.737816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.737904] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 1148.797602] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.797760] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.797838] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.798058] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.798216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.811012] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 1150.250897] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1150.251225] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.825823] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 1150.826122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.695400] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1151.696027] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1153.863416] env[64436]: INFO networking_nsxv3.common.synchronization [req-2554e414-5df2-40c8-981e-b3c0be97abfc req-8be51fa6-7359-4cd1-aaeb-4efc11b66ecd tempest-ServersTestJSON-120118349 tempest-ServersTestJSON-120118349-project-member] Enqueued Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1153.863966] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 with Priority: HIGHEST for action security_group_members [ 1153.864281] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-b396e974-2fce-4ce5-a60d-a8bc929e40e2 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.864479] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.864542] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.864716] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.864881] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.864974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.865148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.865490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.865490] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.865490] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b396e974-2fce-4ce5-a60d-a8bc929e40e2',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.368357] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.368568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.368568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.368881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.368881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.369200] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.369200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.369366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.369442] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.369497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.369570] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 is going to be updated. [ 1154.396961] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.397203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.397329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.397561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.397753] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.407445] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: IN_PROGRESS for 2s [ 1156.418426] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 in Status: SUCCESS [ 1156.418426] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b396e974-2fce-4ce5-a60d-a8bc929e40e2 deletion is rescheduled due to dependency. [ 1156.418426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b396e974-2fce-4ce5-a60d-a8bc929e40e2" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.314142] env[64436]: INFO networking_nsxv3.common.synchronization [None req-446333e3-298e-4cc9-a9d9-e9c061ef7e97 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_rules [ 1157.314694] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_rules [ 1157.315072] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.315228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.315319] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.315584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.315668] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.383261] env[64436]: INFO networking_nsxv3.common.synchronization [None req-5118faa4-902d-4ae6-861d-be713a6d0557 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_rules [ 1157.384016] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_rules [ 1157.384331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.384438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.842028] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.842028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.842028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.842028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.842028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.842028] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c already deleted. [ 1157.842028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.842028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.842028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.842028] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.361209] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.361407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1158.361459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.361650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1158.361742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1158.361836] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c already deleted. [ 1158.361916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.384884] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1162.385151] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1162.569313] env[64436]: INFO networking_nsxv3.common.synchronization [req-9729a7a3-d411-49ab-a78d-819cb05434d5 req-0f0cfae5-3d2d-44e5-8f69-f485ddd54a50 tempest-ServerActionsTestOtherB-634291074 tempest-ServerActionsTestOtherB-634291074-project-member] Enqueued Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1162.569810] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4df507f-e3c4-414d-8e32-1d9e119b190a with Priority: HIGHEST for action security_group_members [ 1162.570121] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4df507f-e3c4-414d-8e32-1d9e119b190a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.570243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.570347] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.571070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.571070] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.571070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.571070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.571070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.571421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.571421] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4df507f-e3c4-414d-8e32-1d9e119b190a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.074145] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.074329] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.074385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.074612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.074708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.074909] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.075026] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.075111] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.075246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.075318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.075413] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a is going to be updated. [ 1163.102750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.102933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.102933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.103164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.103654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.111573] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 2s [ 1163.451809] env[64436]: INFO networking_nsxv3.common.synchronization [req-3018aedc-d1ad-4588-bdfb-b1e3691aeed7 req-34fa2252-7170-48f7-a035-4ea3db35be85 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_members [ 1163.452760] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_members [ 1163.453205] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.455683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.455683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.455683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.455683] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.455683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.455683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.455683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.455683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.455683] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.724184] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.724395] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.724526] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.724801] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.725080] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.725245] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.725368] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.725588] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.725745] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.726105] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.726310] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.726451] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.726568] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.726686] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.726797] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.726932] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.745176] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.745333] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1163.745475] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.745640] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.745913] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-d0df42d9-e318-44fe-b969-11c7db437ede taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.746098] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.746253] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.746578] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.746723] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0df42d9-e318-44fe-b969-11c7db437ede',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.957487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.957659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.957722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.957939] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.958051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.958252] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.958364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.958428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.958581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.958656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.958737] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c already deleted. [ 1163.958816] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.249061] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.249061] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.249061] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.249312] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.249489] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.249695] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port d0df42d9-e318-44fe-b969-11c7db437ede not found, creating... [ 1164.249991] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.250208] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.250363] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.250623] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.250810] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.251109] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.251450] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.251621] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.251867] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.252050] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.252231] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: d0df42d9-e318-44fe-b969-11c7db437ede is going to be created. [ 1164.271479] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.271705] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.271872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.272138] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.272418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.272660] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.940519] env[64436]: INFO networking_nsxv3.common.synchronization [req-3018aedc-d1ad-4588-bdfb-b1e3691aeed7 req-a2f923f2-18c7-4d05-b51f-59bdab53b16c service nova] Enqueued Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_rules [ 1164.940800] env[64436]: INFO networking_nsxv3.common.synchronization [req-3018aedc-d1ad-4588-bdfb-b1e3691aeed7 req-a2f923f2-18c7-4d05-b51f-59bdab53b16c service nova] Enqueued Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_members [ 1164.941033] env[64436]: INFO networking_nsxv3.common.synchronization [req-3018aedc-d1ad-4588-bdfb-b1e3691aeed7 req-a2f923f2-18c7-4d05-b51f-59bdab53b16c service nova] Enqueued Resource ID: d0df42d9-e318-44fe-b969-11c7db437ede with Priority: HIGHEST for action port [ 1164.941717] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_rules [ 1164.941894] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_members [ 1164.942129] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0df42d9-e318-44fe-b969-11c7db437ede with Priority: HIGHEST for action port [ 1164.942520] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.942675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.944151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.944151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.944151] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.944433] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.944433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.944433] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.945465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.945465] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.945465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.945465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.945662] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.945713] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.945832] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.946874] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0df42d9-e318-44fe-b969-11c7db437ede taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.947327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.947327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.947327] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.947449] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0df42d9-e318-44fe-b969-11c7db437ede',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.121078] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: IN_PROGRESS for 4s [ 1165.374021] env[64436]: INFO networking_nsxv3.common.synchronization [req-5825c379-ca72-494f-bce5-aa726852a745 req-c793e200-8376-4e68-9b27-cb82ff336539 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1165.374132] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1165.374398] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.374515] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.374582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.374776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.374924] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.375036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.375100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.375246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.375333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.375426] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.449987] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.450144] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.450312] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.451106] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0df42d9-e318-44fe-b969-11c7db437ede with status ACTIVE [ 1165.451306] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.451466] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.451560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.451734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.451861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.452050] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.452149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.452211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.452385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.452464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.452640] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.452731] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.453120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.453276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.453354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.453439] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0df42d9-e318-44fe-b969-11c7db437ede is going to be updated. [ 1165.473485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.473627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.473669] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.473864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.473996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.474161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0df42d9-e318-44fe-b969-11c7db437ede" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.625444] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.625646] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.625774] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.626052] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.626302] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.626464] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.626586] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.626800] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.626949] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.627336] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.627462] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.627577] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.627690] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.627804] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.627914] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.628062] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.645714] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.645877] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.646054] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.646231] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-313" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.646600] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-100120c7-2f62-448e-a113-2ced21448bae taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.646679] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.646803] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.647113] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.647262] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('100120c7-2f62-448e-a113-2ced21448bae',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.877957] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.957026] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.150112] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.150373] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.150512] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.150799] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.150957] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.151130] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 100120c7-2f62-448e-a113-2ced21448bae not found, creating... [ 1166.151459] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.151636] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.151793] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.152014] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.152169] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.152493] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.152656] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.152781] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.152997] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.153157] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.153303] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 100120c7-2f62-448e-a113-2ced21448bae is going to be created. [ 1166.171875] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.172074] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.172205] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.172476] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.172715] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.172938] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.380398] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.459673] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.459835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.459881] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.460127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.460215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.460313] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c is going to be created. [ 1166.482062] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.482062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.482062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.482062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.482062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.490553] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c in Status: UNINITIALIZED for 2s [ 1166.860249] env[64436]: INFO networking_nsxv3.common.synchronization [req-5825c379-ca72-494f-bce5-aa726852a745 req-c12f1ed5-421c-4227-a052-c88a4516ccf2 service nova] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 1166.861603] env[64436]: INFO networking_nsxv3.common.synchronization [req-5825c379-ca72-494f-bce5-aa726852a745 req-c12f1ed5-421c-4227-a052-c88a4516ccf2 service nova] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1166.861603] env[64436]: INFO networking_nsxv3.common.synchronization [req-5825c379-ca72-494f-bce5-aa726852a745 req-c12f1ed5-421c-4227-a052-c88a4516ccf2 service nova] Enqueued Resource ID: 100120c7-2f62-448e-a113-2ced21448bae with Priority: HIGHEST for action port [ 1166.861603] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_rules [ 1166.861603] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1166.861603] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100120c7-2f62-448e-a113-2ced21448bae with Priority: HIGHEST for action port [ 1166.861974] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.861974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.864052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.864052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.864233] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.865650] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.865650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.866309] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-100120c7-2f62-448e-a113-2ced21448bae taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.866419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.866419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.866629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.866743] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('100120c7-2f62-448e-a113-2ced21448bae',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.883230] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.883473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.883566] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.884063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.884063] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.884063] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be updated. [ 1166.912585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.912749] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.912823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.913060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.913208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.925643] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: IN_PROGRESS for 2s [ 1167.133164] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4df507f-e3c4-414d-8e32-1d9e119b190a in Status: SUCCESS [ 1167.133449] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4df507f-e3c4-414d-8e32-1d9e119b190a deletion is rescheduled due to dependency. [ 1167.133449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4df507f-e3c4-414d-8e32-1d9e119b190a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.369582] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.369692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.369939] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 100120c7-2f62-448e-a113-2ced21448bae with status ACTIVE [ 1167.370138] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.370284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.370373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.370605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.370719] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.370912] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.371045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.371649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.371649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.371649] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.371649] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.371890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.371890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.371948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.372015] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.372098] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 100120c7-2f62-448e-a113-2ced21448bae is going to be updated. [ 1167.391458] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.391610] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.391659] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.391861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.391995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.392164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-100120c7-2f62-448e-a113-2ced21448bae" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.500045] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c in Status: SUCCESS [ 1168.500045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.500045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.500045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.500045] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.500455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.500455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.500455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.500455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.500455] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.500612] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.936309] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 1168.936635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.936986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.937464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.937748] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.937935] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1168.938142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.938352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1168.938489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1168.938626] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.002921] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.441836] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.505836] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a1f3e8e-097e-4971-b84a-1d458e222f4c: rpc.has_security_group_logging(os_id): False [ 1169.522750] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.522975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.523055] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.523281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.523376] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.523644] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.523751] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.523817] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.524050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.524145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.524235] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c is going to be created. [ 1169.582504] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.582704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1169.582780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.582985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1169.583182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.592922] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c in Status: IN_PROGRESS for 2s [ 1169.944139] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.447984] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.448451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.448451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.448599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.448635] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.448733] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be updated. [ 1170.479257] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.479430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1170.479529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.479697] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1170.479875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.489675] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: IN_PROGRESS for 2s [ 1171.604979] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c in Status: SUCCESS [ 1171.605297] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1171.862917] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1171.862917] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1172.499190] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 1172.499407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.499578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.499808] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.499995] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.500135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.500188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.500336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.500416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.500501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.500589] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.002423] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.507091] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a7055f1-b6d2-4437-9167-b5ee510dd08a: rpc.has_security_group_logging(os_id): False [ 1173.523296] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.523296] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1173.523296] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.523526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1173.542822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.543141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.543280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1173.543344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.543514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1173.543615] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.543736] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be updated. [ 1173.601108] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.601298] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1173.601436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.601750] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1173.601979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1173.617024] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: IN_PROGRESS for 2s [ 1174.038706] env[64436]: INFO networking_nsxv3.common.synchronization [None req-5b2d44a5-55f3-4b3f-bd3f-1ea6a898b373 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 83a9b0f4-50ed-4004-9110-592321dc8477 with Priority: HIGHEST for action security_group_rules [ 1174.039665] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a9b0f4-50ed-4004-9110-592321dc8477 with Priority: HIGHEST for action security_group_rules [ 1174.040273] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83a9b0f4-50ed-4004-9110-592321dc8477 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.040463] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.040567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.040903] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.041017] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83a9b0f4-50ed-4004-9110-592321dc8477',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.119230] env[64436]: INFO networking_nsxv3.common.synchronization [None req-d5f024d7-c3dc-4bff-b9e2-f8013e4d4e85 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 83a9b0f4-50ed-4004-9110-592321dc8477 with Priority: HIGHEST for action security_group_rules [ 1174.119909] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a9b0f4-50ed-4004-9110-592321dc8477 with Priority: HIGHEST for action security_group_rules [ 1174.120131] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83a9b0f4-50ed-4004-9110-592321dc8477 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.120258] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.560741] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.560741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1174.560741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.560741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.560741] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.560741] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83a9b0f4-50ed-4004-9110-592321dc8477 already deleted. [ 1174.561103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.561103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.561103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1174.561199] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83a9b0f4-50ed-4004-9110-592321dc8477',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.081331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.081331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.081331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.081331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.081331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.081331] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83a9b0f4-50ed-4004-9110-592321dc8477 already deleted. [ 1175.081331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83a9b0f4-50ed-4004-9110-592321dc8477" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.630925] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 1175.631645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.124345] env[64436]: INFO networking_nsxv3.common.synchronization [req-517e28aa-3761-48f8-a7ad-ce07048653b9 req-da973e28-553f-4c21-a8e8-e9f264cf49d4 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1177.124945] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1177.125281] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.125403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.126369] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.126622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.126786] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.126895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.126961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.127122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.127208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.127300] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.629975] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.630163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.630254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.630456] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.630576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.630785] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.630887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.630948] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.631120] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.631199] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.631283] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1177.660618] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.660756] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.660822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.661031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.661173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.668882] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1179.679153] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1179.679506] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1179.679506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.736642] env[64436]: INFO networking_nsxv3.common.synchronization [req-1cae1dde-5de7-4f2e-a775-2ee3fc374a99 req-4894246e-c96e-48b7-9f50-e0ba1b1222d1 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1179.737195] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1179.737514] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.737637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.737704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.737894] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.738055] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.738159] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.738224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.738372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.738464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.738570] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.114529] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.114730] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.114890] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.115337] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.115660] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.115892] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.116543] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.116813] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.116979] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.117210] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.117331] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.117451] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.117567] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.117683] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.117797] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.117934] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.135331] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.135493] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.135638] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.135809] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.136102] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-37aa55df-ec77-4b87-b177-2ef0852e4a78 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.136269] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.136394] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.136690] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.136834] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37aa55df-ec77-4b87-b177-2ef0852e4a78',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.241758] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.241919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.241992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.242221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.242318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.242729] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.242858] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.242930] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.243115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.243203] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.243299] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1180.268610] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.268737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.268807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.268973] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.269118] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.278087] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1180.640027] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.640027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.640165] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.640416] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.640580] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.640745] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 37aa55df-ec77-4b87-b177-2ef0852e4a78 not found, creating... [ 1180.641164] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.641354] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.641548] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.641795] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.641939] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.642262] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.642465] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.642549] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.642762] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.642901] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.643059] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 37aa55df-ec77-4b87-b177-2ef0852e4a78 is going to be created. [ 1180.670496] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.670689] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.670815] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.671082] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.671319] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.671601] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.377552] env[64436]: INFO networking_nsxv3.common.synchronization [req-1cae1dde-5de7-4f2e-a775-2ee3fc374a99 req-ac131026-b404-4e4d-8018-2ae8e110949a service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1181.377927] env[64436]: INFO networking_nsxv3.common.synchronization [req-1cae1dde-5de7-4f2e-a775-2ee3fc374a99 req-ac131026-b404-4e4d-8018-2ae8e110949a service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1181.378181] env[64436]: INFO networking_nsxv3.common.synchronization [req-1cae1dde-5de7-4f2e-a775-2ee3fc374a99 req-ac131026-b404-4e4d-8018-2ae8e110949a service nova] Enqueued Resource ID: 37aa55df-ec77-4b87-b177-2ef0852e4a78 with Priority: HIGHEST for action port [ 1181.378810] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1181.379021] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1181.379204] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37aa55df-ec77-4b87-b177-2ef0852e4a78 with Priority: HIGHEST for action port [ 1181.379586] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.379757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.379875] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.380179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.380312] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.381276] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.381407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.381816] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-37aa55df-ec77-4b87-b177-2ef0852e4a78 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.381971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.381971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.382229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.382351] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37aa55df-ec77-4b87-b177-2ef0852e4a78',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.884417] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.884548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.884740] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37aa55df-ec77-4b87-b177-2ef0852e4a78 with status ACTIVE [ 1181.884920] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.885119] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.885204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.885412] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.885505] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.885709] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.885761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.885825] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.885975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.886068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.886256] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.886351] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.886414] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.886555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.886632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.886716] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37aa55df-ec77-4b87-b177-2ef0852e4a78 is going to be updated. [ 1181.906188] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.906356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.906420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.906806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.906806] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.906956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37aa55df-ec77-4b87-b177-2ef0852e4a78" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.287519] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1182.287703] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1182.287814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.287965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.288202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.288381] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.288495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.288561] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.288706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.288790] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.288883] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.791555] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.296030] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.798426] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.798743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.798743] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.798871] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.798954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.799066] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1183.825920] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.826125] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.826216] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.826432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.826632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.835110] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1184.716513] env[64436]: INFO networking_nsxv3.common.synchronization [req-0a63db11-fdf9-40de-99d5-d547aee50123 req-c5de5e8d-47d4-4ecc-aa49-07462d3a54fe tempest-ServerActionsTestJSON-349120793 tempest-ServerActionsTestJSON-349120793-project-member] Enqueued Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1184.717129] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 with Priority: HIGHEST for action security_group_members [ 1184.717497] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-0477e290-dfb6-401d-bc8e-f26e35953b43 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.717672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.717774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.718104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.718330] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.718447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1184.718514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.718679] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1184.718769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1184.718862] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0477e290-dfb6-401d-bc8e-f26e35953b43',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.220938] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.221340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.221340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.221416] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.221527] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.221721] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.221823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.221888] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.222053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.222133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.222219] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 is going to be updated. [ 1185.259790] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.259982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.259982] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.260184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.260323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.268501] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: IN_PROGRESS for 2s [ 1185.843996] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1185.844202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.844358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.844582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.844779] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.844896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.844953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.845136] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.845221] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.845308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.845396] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.348086] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.348086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.348086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.348559] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.348559] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.348720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.348776] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.348959] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.349056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.349149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.349299] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.349431] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.349555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.349633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.349782] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.349890] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.349949] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.350140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.350246] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.350341] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.350439] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.852436] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70eef184-9328-4455-90b8-5dfd198676b9: rpc.has_security_group_logging(os_id): False [ 1186.869942] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.870242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.870320] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.870486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.870585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.870808] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.870910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.870974] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.871145] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.871244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.871443] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.871560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.871625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.871771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.871898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.872086] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.872180] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.872241] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.872382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.872457] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.872541] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1186.928665] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.928899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.928994] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.929770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.929770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.944366] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1187.277310] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 in Status: SUCCESS [ 1187.277493] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0477e290-dfb6-401d-bc8e-f26e35953b43 deletion is rescheduled due to dependency. [ 1187.277608] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0477e290-dfb6-401d-bc8e-f26e35953b43" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.960487] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1188.960826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.717807] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1189.717900] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1192.744671] env[64436]: INFO networking_nsxv3.common.synchronization [None req-08e203e1-337b-46d1-9f76-8d8d68af3148 None None] Enqueued Resource ID: b187b9ab-29c6-41f8-bb58-12b34d2a077c with Priority: HIGHEST for action port [ 1192.746013] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b187b9ab-29c6-41f8-bb58-12b34d2a077c with Priority: HIGHEST for action port [ 1192.746454] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-b187b9ab-29c6-41f8-bb58-12b34d2a077c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.746556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b187b9ab-29c6-41f8-bb58-12b34d2a077c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.746629] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b187b9ab-29c6-41f8-bb58-12b34d2a077c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.746882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b187b9ab-29c6-41f8-bb58-12b34d2a077c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.746965] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b187b9ab-29c6-41f8-bb58-12b34d2a077c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.251274] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b187b9ab-29c6-41f8-bb58-12b34d2a077c [ 1193.251493] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.251677] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.251745] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.251965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.252073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.252174] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b187b9ab-29c6-41f8-bb58-12b34d2a077c already deleted. [ 1193.252257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b187b9ab-29c6-41f8-bb58-12b34d2a077c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1194.806073] env[64436]: INFO networking_nsxv3.common.synchronization [None req-611503f8-334d-4065-961b-47d1d8c60050 None None] Enqueued Resource ID: 54766ded-a17d-4471-84c4-fad4cec7fb84 with Priority: HIGHEST for action port [ 1194.806073] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54766ded-a17d-4471-84c4-fad4cec7fb84 with Priority: HIGHEST for action port [ 1194.806073] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-54766ded-a17d-4471-84c4-fad4cec7fb84 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.806073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54766ded-a17d-4471-84c4-fad4cec7fb84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1194.806073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54766ded-a17d-4471-84c4-fad4cec7fb84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.806737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54766ded-a17d-4471-84c4-fad4cec7fb84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1194.806962] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54766ded-a17d-4471-84c4-fad4cec7fb84',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.279740] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1195.279883] env[64436]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1994960d-1d4e-49f2-be12-4ad0ee86f991 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1195.309065] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54766ded-a17d-4471-84c4-fad4cec7fb84 [ 1195.309435] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.309435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.309557] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.309704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.309797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.309987] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54766ded-a17d-4471-84c4-fad4cec7fb84 already deleted. [ 1195.309987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54766ded-a17d-4471-84c4-fad4cec7fb84" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.069363] env[64436]: INFO networking_nsxv3.common.synchronization [req-aa3bdf7b-57d7-4bbd-a6df-4f32bbedf979 req-2a4282f6-dbfb-4a6c-8f12-27051b860a81 tempest-ServerMetadataNegativeTestJSON-1404407593 tempest-ServerMetadataNegativeTestJSON-1404407593-project-member] Enqueued Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_members [ 1198.070253] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_members [ 1198.070253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.070364] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.070399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.070622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.070771] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.070866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.070924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.071307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.072032] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.072032] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.325775] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.325775] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-617" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.325775] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-617" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.326011] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-617" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.326249] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.326426] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.326558] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.326782] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.326935] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.327178] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.327299] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.327423] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.327536] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.327648] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.328193] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.328193] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.347048] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.347263] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1198.347393] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.347567] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-617" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.347867] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.348085] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.348187] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.348486] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.348628] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc373a4d-9e6a-4120-99a2-ebf7e451dca6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.575200] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.575411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.575411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.575584] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.575678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.575957] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.576101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.576168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.576328] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.576407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.576494] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66846e2-90bd-4bb6-817b-c20619593d53 already deleted. [ 1198.576573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.851347] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.851630] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.851756] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.852083] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.852272] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.852412] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port fc373a4d-9e6a-4120-99a2-ebf7e451dca6 not found, creating... [ 1198.852706] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.852874] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.853012] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.853546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.853546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.853711] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.854346] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.854346] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.854346] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.854346] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.854624] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: fc373a4d-9e6a-4120-99a2-ebf7e451dca6 is going to be created. [ 1198.874071] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.874473] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1198.874473] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.874721] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1198.874968] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.875222] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.571525] env[64436]: INFO networking_nsxv3.common.synchronization [req-aa3bdf7b-57d7-4bbd-a6df-4f32bbedf979 req-49a5ff64-b937-4a52-a9ee-ae55c7d37d73 service nova] Enqueued Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_rules [ 1199.571830] env[64436]: INFO networking_nsxv3.common.synchronization [req-aa3bdf7b-57d7-4bbd-a6df-4f32bbedf979 req-49a5ff64-b937-4a52-a9ee-ae55c7d37d73 service nova] Enqueued Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_members [ 1199.571906] env[64436]: INFO networking_nsxv3.common.synchronization [req-aa3bdf7b-57d7-4bbd-a6df-4f32bbedf979 req-49a5ff64-b937-4a52-a9ee-ae55c7d37d73 service nova] Enqueued Resource ID: fc373a4d-9e6a-4120-99a2-ebf7e451dca6 with Priority: HIGHEST for action port [ 1199.572135] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_rules [ 1199.572299] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_members [ 1199.572346] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc373a4d-9e6a-4120-99a2-ebf7e451dca6 with Priority: HIGHEST for action port [ 1199.572889] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.573113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.573201] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.573460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.573544] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.574362] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.574468] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.574543] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.574708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.575708] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.575708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.575708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.575708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.575708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1199.575708] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.576121] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.576121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1199.576235] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.577114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1199.577205] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc373a4d-9e6a-4120-99a2-ebf7e451dca6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.079012] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.080099] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.080244] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.080389] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc373a4d-9e6a-4120-99a2-ebf7e451dca6 with status ACTIVE [ 1200.080958] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.080958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.080958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.080958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.081253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.081253] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.081336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.081368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.081538] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.081593] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.081797] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.081899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.081956] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.082304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.082415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.082463] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc373a4d-9e6a-4120-99a2-ebf7e451dca6 is going to be updated. [ 1200.103050] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.103239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1200.103293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.103502] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1200.103691] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.103844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc373a4d-9e6a-4120-99a2-ebf7e451dca6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.584433] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.086514] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.086733] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1201.087316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.087316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1201.087316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.087316] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66846e2-90bd-4bb6-817b-c20619593d53 is going to be created. [ 1201.111524] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.111834] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1201.111927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.112133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1201.112861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1201.120940] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66846e2-90bd-4bb6-817b-c20619593d53 in Status: UNINITIALIZED for 2s [ 1203.131524] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66846e2-90bd-4bb6-817b-c20619593d53 in Status: UNINITIALIZED for 4s [ 1204.573405] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.573784] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1205.142181] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66846e2-90bd-4bb6-817b-c20619593d53 in Status: SUCCESS [ 1205.142409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.142748] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.143071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.143303] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.143450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.143537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.143700] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.143828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.143960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.144117] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.646481] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.646906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.646906] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.647038] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.647191] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.647299] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.647358] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.647517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.647707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.647707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.647817] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.647913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.647975] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.648121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.648249] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.648330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.648393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.648514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.648594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.648663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.648737] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.151325] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e66846e2-90bd-4bb6-817b-c20619593d53: rpc.has_security_group_logging(os_id): False [ 1206.169083] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.169300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.169300] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.169514] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.169689] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.169947] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.170065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.170147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.170301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.170378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.170554] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.170651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.170730] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.170845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.170912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.171102] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.171189] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.171254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.171383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.171452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.171538] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e66846e2-90bd-4bb6-817b-c20619593d53 is going to be created. [ 1206.225169] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.225424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.225424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.225587] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.225771] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.235651] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e66846e2-90bd-4bb6-817b-c20619593d53 in Status: IN_PROGRESS for 2s [ 1208.239494] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.239964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.239964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.239964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.240126] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.247587] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e66846e2-90bd-4bb6-817b-c20619593d53 in Status: SUCCESS [ 1208.247851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.742636] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.245038] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.574194] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1209.574312] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1209.601444] env[64436]: INFO networking_nsxv3.common.synchronization [req-49a70784-8fdf-46fe-9329-6cb0d1c9f295 req-cd30239e-6b27-478d-bebc-feba7d44d518 tempest-ServerMetadataNegativeTestJSON-1404407593 tempest-ServerMetadataNegativeTestJSON-1404407593-project-member] Enqueued Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_members [ 1209.601990] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGHEST for action security_group_members [ 1209.602321] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.602465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.602497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.603796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.603796] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.603796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1209.603796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.603796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1209.603796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1209.603796] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.747017] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1209.747193] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1210.106296] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.106436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.106524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.106738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.106835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.107069] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.107208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.107271] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.107430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.107511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.107600] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66846e2-90bd-4bb6-817b-c20619593d53 is going to be updated. [ 1210.142047] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.142047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.142047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.142047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.142047] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.151669] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66846e2-90bd-4bb6-817b-c20619593d53 in Status: IN_PROGRESS for 2s [ 1210.523121] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.523121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.523121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.523121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.535777] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1210.536687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.537405] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1210.576495] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.576724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.576724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.576896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.590259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.591055] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1210.591143] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1210.591237] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1210.636745] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.636850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.636923] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.637156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.638365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.639030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1210.708654] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.708654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.708654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.708887] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.709182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.709464] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1210.820554] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.820767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.820767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.820991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.821304] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.821601] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1210.821760] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0af8c995-71f2-4efa-a95d-9e0e461fe445', 'e66846e2-90bd-4bb6-817b-c20619593d53', '0f75433d-92b0-49c0-b145-a45f748925ab', '1e217869-d443-46d3-8722-54105951b88c', '0117c794-a2fb-459b-b43a-f26e5487cf02', '5a84c314-4b02-42db-a1d1-74e8ea62582f', '8a1f3e8e-097e-4971-b84a-1d458e222f4c', 'cb19e790-7043-4bc8-8786-ef2a1406ff06', 'b271b036-4ee8-48b7-9a6a-455fa62def61', 'f8d51f49-2f07-4baa-93f3-f28849ea55ba', '3ca0f983-827d-4279-9163-19aa19101851', 'cb56bfd6-0103-472c-bec4-cf6580a4f904', '9741d578-5b29-42b0-b0b6-dfd97b1c7306', '2a7055f1-b6d2-4437-9167-b5ee510dd08a', 'aeeb0085-3d91-4859-b6e8-d553406b2219', 'f24df5e6-b8ac-4b7a-898c-90fa972dda35', 'fbe8273e-23a4-44f7-a432-9d347c32cd2d', '70eef184-9328-4455-90b8-5dfd198676b9', 'ad80987d-a16f-49ad-a3ce-836e3cca1187', '6c2d8d81-8cc8-44df-9d77-63cb789204d8', 'ddee3b8b-6805-4cc6-99b5-47b0c8059fc3', 'b396e974-2fce-4ce5-a60d-a8bc929e40e2', '80355bd7-8e39-4ae8-bf46-4d775230b0d4', 'f7502962-276d-43f0-96f0-2447f12d3137', 'af9ecb31-3f5b-4d0a-b3bd-ba27e6d375b9', 'cfb4c1c6-2021-458b-840f-cd83ee502c3d', '3cc5500f-a0f5-4e87-aa9b-0020789243e9', '8a6f90a6-21e9-4dc5-8fbc-4979ed7a4d7e', '6d226089-248b-47ba-bfe1-ba9fc67ca294', 'b915a177-2742-49be-9ca9-2dc30ee9c6ac', 'a9ef4caa-55e7-4f89-9577-78cea5744bdb', '7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff', 'c2485258-5c59-4503-a9df-3f4d9b5bebdb', '3ed89fd9-eeee-4f35-9707-895a0fcd48b0', 'e04160bc-db4b-4c32-8c62-3a41769c7c95', '0477e290-dfb6-401d-bc8e-f26e35953b43', 'ee94a361-ec26-4356-a9e8-dacb252b81bb', 'd1017fee-6833-4760-849a-3861937d36d9', 'a22f030d-b590-48f1-adde-d139f2aa31d4', '377c820a-e6ee-48bb-9450-abc7d40a08d0', '1b20bfe1-a213-442b-9906-0002d7f3fe25', 'c4df507f-e3c4-414d-8e32-1d9e119b190a', '73a0cec9-fcd4-4729-abd7-b50d1439753c'} {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1210.821875] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1210.839648] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.839798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.839861] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.840110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.840195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.840307] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1210.840377] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1210.840451] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1210.872507] env[64436]: INFO networking_nsxv3.common.synchronization [req-47486be9-6349-4c35-a072-f1da2ef45a26 req-c2c12e4d-0b6b-4a55-8820-ccb1575c734f tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_members [ 1210.873093] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGHEST for action security_group_members [ 1210.873409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.873526] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.873592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.873779] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.873923] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.874039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.874090] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.874229] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.874311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.874397] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.912668] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.912839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.912898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.913093] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.914239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.914486] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1210.914565] env[64436]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=64436) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1210.914637] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1210.914705] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1210.914781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1210.914851] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGH for action security_group_rules [ 1210.914931] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGH for action security_group_rules [ 1210.915045] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGH for action security_group_rules [ 1210.915122] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGH for action security_group_rules [ 1210.915186] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGH for action security_group_rules [ 1210.915249] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGH for action security_group_rules [ 1210.915311] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGH for action security_group_rules [ 1210.915374] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGH for action security_group_rules [ 1210.915435] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGH for action security_group_rules [ 1210.915496] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGH for action security_group_rules [ 1210.915557] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGH for action security_group_rules [ 1210.915618] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGH for action security_group_rules [ 1210.915679] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGH for action security_group_rules [ 1210.915741] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGH for action security_group_rules [ 1210.915804] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGH for action security_group_rules [ 1210.915904] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGH for action security_group_rules [ 1210.915952] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGH for action security_group_rules [ 1210.915999] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGH for action security_group_rules [ 1210.916052] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGH for action security_group_rules [ 1210.916109] env[64436]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGH for action security_group_rules [ 1210.916202] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.377089] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.377089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.377089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.377089] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.400217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.400461] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.400577] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.400644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.400843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.400926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.401025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c is going to be updated. [ 1211.429544] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.429805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.429805] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.429925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.430051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.437173] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c in Status: IN_PROGRESS for 2s [ 1212.160360] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66846e2-90bd-4bb6-817b-c20619593d53 in Status: SUCCESS [ 1212.160639] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66846e2-90bd-4bb6-817b-c20619593d53 deletion is rescheduled due to dependency. [ 1212.160639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.446299] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c in Status: SUCCESS [ 1213.446612] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c deletion is rescheduled due to dependency. [ 1213.446612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1215.874833] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.875145] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1215.875145] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 with Priority: HIGH for action security_group_rules [ 1215.875223] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f75433d-92b0-49c0-b145-a45f748925ab with Priority: HIGH for action security_group_rules [ 1215.875312] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c with Priority: HIGH for action security_group_rules [ 1215.875413] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb0085-3d91-4859-b6e8-d553406b2219 with Priority: HIGH for action security_group_rules [ 1215.875504] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 with Priority: HIGH for action security_group_rules [ 1215.875597] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 with Priority: HIGH for action security_group_rules [ 1215.875689] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGH for action security_group_rules [ 1215.875786] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d with Priority: HIGH for action security_group_rules [ 1215.876520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGH for action security_group_rules [ 1215.876520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 with Priority: HIGH for action security_group_rules [ 1215.876520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 with Priority: HIGH for action security_group_rules [ 1215.876520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 with Priority: HIGH for action security_group_rules [ 1215.876520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca0f983-827d-4279-9163-19aa19101851 with Priority: HIGH for action security_group_rules [ 1215.876520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba with Priority: HIGH for action security_group_rules [ 1215.876520] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b271b036-4ee8-48b7-9a6a-455fa62def61 with Priority: HIGH for action security_group_rules [ 1215.876822] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f with Priority: HIGH for action security_group_rules [ 1215.876822] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 with Priority: HIGH for action security_group_rules [ 1215.876822] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 with Priority: HIGH for action security_group_rules [ 1215.876822] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66846e2-90bd-4bb6-817b-c20619593d53 with Priority: HIGH for action security_group_rules [ 1215.876964] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e217869-d443-46d3-8722-54105951b88c with Priority: HIGH for action security_group_rules [ 1215.877264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0af8c995-71f2-4efa-a95d-9e0e461fe445 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.877398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.877459] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.877671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.877752] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0af8c995-71f2-4efa-a95d-9e0e461fe445',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.878751] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f75433d-92b0-49c0-b145-a45f748925ab taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.878879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.878953] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.879135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.879212] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f75433d-92b0-49c0-b145-a45f748925ab',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.879954] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.880072] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.880137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.880451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.880451] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a1f3e8e-097e-4971-b84a-1d458e222f4c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.881214] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeeb0085-3d91-4859-b6e8-d553406b2219 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.881330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.881397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.881545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.881617] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeeb0085-3d91-4859-b6e8-d553406b2219',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.882341] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.882450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.882507] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.882653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.882748] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c2d8d81-8cc8-44df-9d77-63cb789204d8',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.883473] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad80987d-a16f-49ad-a3ce-836e3cca1187 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.884254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.884254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.884254] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.884254] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad80987d-a16f-49ad-a3ce-836e3cca1187',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.884461] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.884618] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.884618] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.884763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.884837] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.885661] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.885767] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.885835] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.885987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.886063] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbe8273e-23a4-44f7-a432-9d347c32cd2d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.886722] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.886826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.886893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.887056] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.887151] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.887781] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.888028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.888028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.888165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.888217] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f24df5e6-b8ac-4b7a-898c-90fa972dda35',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.888977] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.889094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.889160] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.889309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.889380] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9741d578-5b29-42b0-b0b6-dfd97b1c7306',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.890047] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb56bfd6-0103-472c-bec4-cf6580a4f904 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.890156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.890222] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.890382] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.890455] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb56bfd6-0103-472c-bec4-cf6580a4f904',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.891246] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca0f983-827d-4279-9163-19aa19101851 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.891371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.891439] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.891596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.891667] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca0f983-827d-4279-9163-19aa19101851',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.892370] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.892573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.892643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.892797] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.892868] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8d51f49-2f07-4baa-93f3-f28849ea55ba',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.893526] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b271b036-4ee8-48b7-9a6a-455fa62def61 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.893634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.893728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.894104] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.894219] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b271b036-4ee8-48b7-9a6a-455fa62def61',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.894886] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a84c314-4b02-42db-a1d1-74e8ea62582f taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.894944] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.895011] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.895168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.895407] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a84c314-4b02-42db-a1d1-74e8ea62582f',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.895922] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb19e790-7043-4bc8-8786-ef2a1406ff06 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.896036] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.896135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.896255] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.896330] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb19e790-7043-4bc8-8786-ef2a1406ff06',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.897099] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0117c794-a2fb-459b-b43a-f26e5487cf02 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.897210] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.897276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.897511] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.897590] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0117c794-a2fb-459b-b43a-f26e5487cf02',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.898258] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e66846e2-90bd-4bb6-817b-c20619593d53 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.898366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.898432] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.898581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.898650] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e66846e2-90bd-4bb6-817b-c20619593d53',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.899565] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e217869-d443-46d3-8722-54105951b88c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.899619] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1215.899690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.899845] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1215.899918] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e217869-d443-46d3-8722-54105951b88c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.404481] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.404663] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.404711] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.404896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.405078] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.405184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.405247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.405398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.405484] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.405570] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.405653] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.416318] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.416576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.416576] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.416722] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.416887] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.416988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.417062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.417212] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.417296] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.417381] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.417461] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.433998] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.465906] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.466064] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.466138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.466346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.467969] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.468079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.471896] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.471999] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.474170] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.474267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.474998] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.475142] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.475949] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.476066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.476823] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.476918] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.477765] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.477879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.478723] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.478814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.479487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.479580] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.480249] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.480340] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.481021] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.481446] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.481498] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.482145] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.482524] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.482683] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.483536] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.483912] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.484028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.484640] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.485059] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.485214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.486078] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.486488] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.486582] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.487191] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.487534] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.487627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.488271] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.488645] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.488712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.490548] env[64436]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1216.490950] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.491072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad80987d-a16f-49ad-a3ce-836e3cca1187 is going to be deleted. [ 1216.491907] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.492117] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.506710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.506816] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0117c794-a2fb-459b-b43a-f26e5487cf02 is going to be deleted. [ 1216.507551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.507732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.524071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.524206] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f24df5e6-b8ac-4b7a-898c-90fa972dda35 is going to be deleted. [ 1216.524931] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.525131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.540911] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.541045] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.542908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.543075] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb56bfd6-0103-472c-bec4-cf6580a4f904 is going to be deleted. [ 1216.543850] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.544050] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.562670] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.562807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.571628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.571743] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c2d8d81-8cc8-44df-9d77-63cb789204d8 is going to be deleted. [ 1216.572555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.572747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.585727] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.585841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.625208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.625337] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a84c314-4b02-42db-a1d1-74e8ea62582f is going to be deleted. [ 1216.626204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.626426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.655486] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.655650] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.670496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.670658] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.675497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.675606] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeeb0085-3d91-4859-b6e8-d553406b2219 is going to be deleted. [ 1216.676426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.676627] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.718404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.718536] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b271b036-4ee8-48b7-9a6a-455fa62def61 is going to be deleted. [ 1216.719534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.719653] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.757485] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.757660] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.762978] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.763106] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8d51f49-2f07-4baa-93f3-f28849ea55ba is going to be deleted. [ 1216.763919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.764139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.785101] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.785249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.790214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.790326] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e66846e2-90bd-4bb6-817b-c20619593d53 is going to be deleted. [ 1216.791081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.791285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.858043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.858232] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb19e790-7043-4bc8-8786-ef2a1406ff06 is going to be deleted. [ 1216.859240] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.859500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.859625] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.859744] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a1f3e8e-097e-4971-b84a-1d458e222f4c is going to be deleted. [ 1216.860628] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.860826] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.877116] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.877421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.927886] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.928086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.928179] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.928396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.928585] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.928703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.928777] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.928961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.929071] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.929188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.929356] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.929469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.929530] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.929678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.929858] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.929961] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1216.930049] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.930190] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.930283] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.930378] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.930493] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.941126] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a7055f1-b6d2-4437-9167-b5ee510dd08a: rpc.has_security_group_logging(os_id): False [ 1216.947717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1216.947841] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbe8273e-23a4-44f7-a432-9d347c32cd2d is going to be deleted. [ 1216.948634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.948818] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1216.971942] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.972078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.006802] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.007147] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.017865] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.017992] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9741d578-5b29-42b0-b0b6-dfd97b1c7306 is going to be deleted. [ 1217.018879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.019105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.028179] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.028290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.036309] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.036423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.038261] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.038360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.062844] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.062995] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f75433d-92b0-49c0-b145-a45f748925ab is going to be deleted. [ 1217.063954] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.064263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.168023] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.168218] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0af8c995-71f2-4efa-a95d-9e0e461fe445 is going to be deleted. [ 1217.169354] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.169590] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.172770] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.172900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.209258] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.209470] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.222296] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.222448] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.226123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.226281] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca0f983-827d-4279-9163-19aa19101851 is going to be deleted. [ 1217.227313] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.227411] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.273823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.273949] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e217869-d443-46d3-8722-54105951b88c is going to be deleted. [ 1217.274822] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.275041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.275138] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.275260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad80987d-a16f-49ad-a3ce-836e3cca1187" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.275417] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.275581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.275664] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.276115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0117c794-a2fb-459b-b43a-f26e5487cf02" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.276256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.276403] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.276488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.276616] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f24df5e6-b8ac-4b7a-898c-90fa972dda35" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.276744] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.276886] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.276964] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.277086] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb56bfd6-0103-472c-bec4-cf6580a4f904" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.277209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.277352] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.277424] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.277523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c2d8d81-8cc8-44df-9d77-63cb789204d8" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.277645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.277782] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.277857] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.277963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a84c314-4b02-42db-a1d1-74e8ea62582f" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.278100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.278237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.278315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.278421] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeeb0085-3d91-4859-b6e8-d553406b2219" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.278537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.278673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.278746] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.278852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b271b036-4ee8-48b7-9a6a-455fa62def61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.278970] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.279121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.308315] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.308436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.327839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.328141] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.328243] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.328310] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.328486] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.328569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.328791] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be updated. [ 1217.329676] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.329809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.329896] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.330016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8d51f49-2f07-4baa-93f3-f28849ea55ba" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.330141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.330293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.330362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.330469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb19e790-7043-4bc8-8786-ef2a1406ff06" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.330605] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.330755] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.330833] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.330972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e66846e2-90bd-4bb6-817b-c20619593d53" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.331096] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.331236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.331311] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.331423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a1f3e8e-097e-4971-b84a-1d458e222f4c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.331943] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.332113] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.332188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.332344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbe8273e-23a4-44f7-a432-9d347c32cd2d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.332460] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.332599] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.332675] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.332820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9741d578-5b29-42b0-b0b6-dfd97b1c7306" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.332955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.333109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.333185] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.333285] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f75433d-92b0-49c0-b145-a45f748925ab" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.333397] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.333532] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.333607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.333708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0af8c995-71f2-4efa-a95d-9e0e461fe445" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.337714] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.337823] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.337884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.338040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.338124] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.338231] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca0f983-827d-4279-9163-19aa19101851" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.383300] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.383438] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.383510] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.383707] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.383799] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.383915] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e217869-d443-46d3-8722-54105951b88c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.432464] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70eef184-9328-4455-90b8-5dfd198676b9: rpc.has_security_group_logging(os_id): False [ 1217.464839] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.464992] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.465068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.465268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.478832] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.478960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.513946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.513946] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.513946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.513946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.514214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.514214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.514418] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.514524] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.514589] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.514738] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.514813] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.514990] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.515075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.515141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.515280] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.515373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.515520] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1217.516546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.517263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.517263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.534234] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: IN_PROGRESS for 2s [ 1217.580367] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.580492] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1217.580548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.580770] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1217.580917] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1217.616766] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1218.355161] env[64436]: INFO networking_nsxv3.common.synchronization [req-9d93745c-43b7-4f8e-93b3-759c89b767fe req-0928b9da-2e33-4c2f-bd40-6ec9d90589c3 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1218.355657] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1218.355959] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.356099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.356168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.356362] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.356518] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.356614] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.356704] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.356960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.356960] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.357059] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.859685] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.859909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.859909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.860068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.860171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.860390] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.860501] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.860565] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.860729] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.860814] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.860910] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1218.887375] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.887569] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1218.887657] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.887937] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1218.888129] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1218.897162] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1219.547047] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 1219.547408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.633690] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1219.633878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1220.906707] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1220.907098] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1220.907098] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1220.963524] env[64436]: INFO networking_nsxv3.common.synchronization [req-3bf4d334-716e-4c8a-8578-d9341c39a51f req-2bb61f71-51a2-4723-b397-28d2fa317594 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1220.964077] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1220.964393] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.964512] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1220.964581] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.964772] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1220.964961] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.965060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1220.965114] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.965236] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1220.965321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1220.965434] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.194185] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.194185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.194185] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.194458] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.194507] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.194657] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.194785] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.195010] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.195209] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.195428] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.195546] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.195659] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.195770] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.195884] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.195995] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.196144] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.213822] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.214051] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1221.214137] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.214308] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-61" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.214582] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-0c55258f-debb-4533-9be6-e98b3f0e19a6 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.214748] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.214872] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.215191] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.215334] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c55258f-debb-4533-9be6-e98b3f0e19a6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.467202] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.467419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.467419] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.467573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.467665] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.467862] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.467965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.468043] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.468197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.468273] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.468357] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1221.495733] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.495884] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.495926] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.496101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.496237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.504590] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1221.717161] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.717426] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.717529] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.717832] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.717996] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.718177] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 0c55258f-debb-4533-9be6-e98b3f0e19a6 not found, creating... [ 1221.718454] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.718619] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.718742] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.718968] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.719126] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.719412] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.719572] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.719722] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.719977] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.720198] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.720352] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 0c55258f-debb-4533-9be6-e98b3f0e19a6 is going to be created. [ 1221.741196] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.741409] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1221.741541] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.741845] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1221.742409] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1221.742409] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.407248] env[64436]: INFO networking_nsxv3.common.synchronization [req-3bf4d334-716e-4c8a-8578-d9341c39a51f req-3d418973-d96a-4183-b810-8a1c89ca5b68 service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1222.407572] env[64436]: INFO networking_nsxv3.common.synchronization [req-3bf4d334-716e-4c8a-8578-d9341c39a51f req-3d418973-d96a-4183-b810-8a1c89ca5b68 service nova] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1222.407669] env[64436]: INFO networking_nsxv3.common.synchronization [req-3bf4d334-716e-4c8a-8578-d9341c39a51f req-3d418973-d96a-4183-b810-8a1c89ca5b68 service nova] Enqueued Resource ID: 0c55258f-debb-4533-9be6-e98b3f0e19a6 with Priority: HIGHEST for action port [ 1222.407897] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_rules [ 1222.408036] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1222.408134] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c55258f-debb-4533-9be6-e98b3f0e19a6 with Priority: HIGHEST for action port [ 1222.408684] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.408793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.408883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.409095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.409193] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.409991] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.410103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.410717] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c55258f-debb-4533-9be6-e98b3f0e19a6 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.410717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.410717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.410717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.410717] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c55258f-debb-4533-9be6-e98b3f0e19a6',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.912476] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.912640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.912832] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c55258f-debb-4533-9be6-e98b3f0e19a6 with status ACTIVE [ 1222.913055] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.913175] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.913318] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.913487] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.913639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.913785] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.913924] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.913998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.914251] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.914334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.914515] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.914611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.914673] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.914809] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.914882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.916393] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c55258f-debb-4533-9be6-e98b3f0e19a6 is going to be updated. [ 1222.936428] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.936595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.936595] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.936717] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.936846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.936998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c55258f-debb-4533-9be6-e98b3f0e19a6" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.521162] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1223.521483] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1223.521483] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.521620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.521828] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1223.522031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.522153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1223.522215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.522371] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1223.522451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1223.522542] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.024718] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.287276] env[64436]: INFO networking_nsxv3.common.synchronization [req-3a91f3f4-c5ee-4051-88b9-5661cafde48c req-0637d844-3efd-41fd-b72b-6fa847c3c243 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_members [ 1224.287805] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff with Priority: HIGHEST for action security_group_members [ 1224.288504] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.289428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.289500] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.289706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.289932] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.290080] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.290153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.290302] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.290389] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.290500] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.527310] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.793261] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.793461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.793508] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.793710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.814290] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.814500] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.814611] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.814678] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.814852] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.814932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.815027] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff is going to be updated. [ 1224.839884] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.840048] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1224.840099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.840388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1224.840551] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.847945] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff in Status: IN_PROGRESS for 2s [ 1225.030542] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.031692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.031692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.031692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.031692] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.031692] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1225.059564] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.059564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1225.059564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.059564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1225.059564] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1225.066246] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1226.857732] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff in Status: SUCCESS [ 1226.857732] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff deletion is rescheduled due to dependency. [ 1226.857732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e3a534c-7b1f-4d55-9dda-7cb39c88f8ff" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.075039] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1227.075426] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.075571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.075853] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.076062] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.076183] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.076321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.076406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.076482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.076568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.076660] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.579913] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.579913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.579913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.579913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.579913] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.579913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.579913] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.580402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.580402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.580402] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.580402] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.580546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.580546] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.580672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.580805] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.580898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1227.580965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.581127] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1227.581206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.581288] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.581375] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.083292] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70eef184-9328-4455-90b8-5dfd198676b9: rpc.has_security_group_logging(os_id): False [ 1228.100776] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.100928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.100998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.101238] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.101330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.101552] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.101651] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.101708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.101889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.101987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.102159] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.102260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.102316] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.102444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.102529] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.102693] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.102780] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.102846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.102998] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.103088] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.103167] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1228.161340] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.161523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.161523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.161721] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.161904] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1228.197167] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1228.857828] env[64436]: INFO networking_nsxv3.common.synchronization [None req-ab93d837-43fb-4b2a-990c-e084999f8ef7 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_rules [ 1228.858468] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_rules [ 1228.858800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1a459f0-d6c9-4693-a4db-91441792ad77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.858927] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.859017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.859292] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.859377] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.925205] env[64436]: INFO networking_nsxv3.common.synchronization [None req-90f10d3a-e668-49d1-a007-3b339cac82ed tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_rules [ 1228.925729] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_rules [ 1228.926052] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1a459f0-d6c9-4693-a4db-91441792ad77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.926161] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.378163] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.378506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.378506] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.378622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.378703] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.378865] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1a459f0-d6c9-4693-a4db-91441792ad77 already deleted. [ 1229.378988] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.379184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.379385] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.379489] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.899961] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.900166] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.900219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.900409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.900497] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.900590] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1a459f0-d6c9-4693-a4db-91441792ad77 already deleted. [ 1229.900671] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.216582] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1230.216811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.492133] env[64436]: INFO networking_nsxv3.common.synchronization [req-59e1b9f6-0233-473d-9fd8-52f8529877c9 req-c48f4716-0bca-4eaa-b029-a74920d2c8f7 tempest-ServerDiskConfigTestJSON-831926176 tempest-ServerDiskConfigTestJSON-831926176-project-member] Enqueued Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1232.492841] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70eef184-9328-4455-90b8-5dfd198676b9 with Priority: HIGHEST for action security_group_members [ 1232.493449] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-70eef184-9328-4455-90b8-5dfd198676b9 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.493449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.493449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.493681] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.493681] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.493763] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.493811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.494278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.494278] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.495100] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70eef184-9328-4455-90b8-5dfd198676b9',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.996542] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.996747] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.996841] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.996987] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.997099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.997296] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.997404] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.997464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.997622] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.997696] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.997781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 is going to be updated. [ 1233.024850] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.025040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1233.025040] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.025200] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.025331] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.033420] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: IN_PROGRESS for 2s [ 1234.225103] env[64436]: INFO networking_nsxv3.common.synchronization [req-303c152d-91b2-4e26-bece-d07a70c7c996 req-c7e9c660-5105-4c4f-bf3f-532357787ee5 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_members [ 1234.225631] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_members [ 1234.225936] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1a459f0-d6c9-4693-a4db-91441792ad77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.226074] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.226141] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.226398] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.226990] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.227156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.227301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.227727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.227727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.227727] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.480871] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.481094] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.481233] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.481509] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.481771] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.481967] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.482445] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.482700] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.482857] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.483115] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.483242] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.483359] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.483474] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.483588] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.483699] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.483835] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.500803] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.500979] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.501147] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.501337] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.501632] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-f2b48fcb-1355-4927-b167-9102f7ddd8b0 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.501799] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.501951] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.502414] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.502414] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b48fcb-1355-4927-b167-9102f7ddd8b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.730876] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.731097] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.731195] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.731333] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.731422] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.731621] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.731727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.731791] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.732016] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.732122] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.732195] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1a459f0-d6c9-4693-a4db-91441792ad77 already deleted. [ 1234.732253] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.005040] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.005300] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.005458] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.005810] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.006212] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.006475] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port f2b48fcb-1355-4927-b167-9102f7ddd8b0 not found, creating... [ 1235.006790] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.006970] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.007110] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.007411] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.007532] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.007846] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.008024] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.008152] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.008546] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.008811] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.009351] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: f2b48fcb-1355-4927-b167-9102f7ddd8b0 is going to be created. [ 1235.027392] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.027571] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.027710] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.027976] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.028238] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.028465] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.041897] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70eef184-9328-4455-90b8-5dfd198676b9 in Status: SUCCESS [ 1235.042219] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70eef184-9328-4455-90b8-5dfd198676b9 deletion is rescheduled due to dependency. [ 1235.042337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70eef184-9328-4455-90b8-5dfd198676b9" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.704219] env[64436]: INFO networking_nsxv3.common.synchronization [req-303c152d-91b2-4e26-bece-d07a70c7c996 req-0279332e-74d8-46d1-869f-d1d55c1da9c7 service nova] Enqueued Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_rules [ 1235.704219] env[64436]: INFO networking_nsxv3.common.synchronization [req-303c152d-91b2-4e26-bece-d07a70c7c996 req-0279332e-74d8-46d1-869f-d1d55c1da9c7 service nova] Enqueued Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_members [ 1235.704219] env[64436]: INFO networking_nsxv3.common.synchronization [req-303c152d-91b2-4e26-bece-d07a70c7c996 req-0279332e-74d8-46d1-869f-d1d55c1da9c7 service nova] Enqueued Resource ID: f2b48fcb-1355-4927-b167-9102f7ddd8b0 with Priority: HIGHEST for action port [ 1235.704525] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_rules [ 1235.704591] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_members [ 1235.704689] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b48fcb-1355-4927-b167-9102f7ddd8b0 with Priority: HIGHEST for action port [ 1235.705720] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1a459f0-d6c9-4693-a4db-91441792ad77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.705851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.705942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.706134] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.706234] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.707482] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1a459f0-d6c9-4693-a4db-91441792ad77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.707567] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.707637] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.708031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.708031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.708151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.708151] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.708345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.708345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.708461] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.713264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2b48fcb-1355-4927-b167-9102f7ddd8b0 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.713407] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.713471] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.713636] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.713715] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b48fcb-1355-4927-b167-9102f7ddd8b0',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.209044] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1a459f0-d6c9-4693-a4db-91441792ad77 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.209205] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.213511] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.215853] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2b48fcb-1355-4927-b167-9102f7ddd8b0 with status ACTIVE [ 1236.216058] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.216239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.216239] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.216446] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.216536] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.216710] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.216807] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.216877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.217020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.217095] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.217279] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.217372] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.217429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.217568] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.217642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.217724] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2b48fcb-1355-4927-b167-9102f7ddd8b0 is going to be updated. [ 1236.236556] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.236686] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.236727] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.236882] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.237014] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.237165] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2b48fcb-1355-4927-b167-9102f7ddd8b0" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.715817] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.939821] env[64436]: INFO networking_nsxv3.common.synchronization [req-751da881-a5cb-44da-8a13-c9135767fada req-f69040cf-7b52-4130-a6e2-094d715a8df0 tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1236.940529] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1236.941112] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.941249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.941345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.941631] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.941851] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.942017] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.942132] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.942344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.942469] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.942729] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.219728] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.219728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.219728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.219728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.219728] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.219728] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1a459f0-d6c9-4693-a4db-91441792ad77 is going to be created. [ 1237.241498] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.241655] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.241708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.241909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.242131] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.250647] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1a459f0-d6c9-4693-a4db-91441792ad77 in Status: UNINITIALIZED for 2s [ 1237.445227] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.948831] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.451197] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.451197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.451332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.451453] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.451545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.451646] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be updated. [ 1238.476425] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.476571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1238.476643] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.476847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1238.476989] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1238.494240] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: IN_PROGRESS for 2s [ 1239.259756] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1a459f0-d6c9-4693-a4db-91441792ad77 in Status: SUCCESS [ 1239.260068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.260139] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.260346] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.260534] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.260648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.260714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.260866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.260951] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.261051] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.261144] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.762843] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.265072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1a459f0-d6c9-4693-a4db-91441792ad77: rpc.has_security_group_logging(os_id): False [ 1240.283345] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.283488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.283556] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.283769] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.283855] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.284099] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.284198] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.284260] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.284449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.284523] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.284604] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1a459f0-d6c9-4693-a4db-91441792ad77 is going to be created. [ 1240.343761] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.343893] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.343972] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.344209] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.344392] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.354833] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1a459f0-d6c9-4693-a4db-91441792ad77 in Status: IN_PROGRESS for 2s [ 1240.507720] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 1240.507720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1241.942047] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.942269] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1242.366269] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1a459f0-d6c9-4693-a4db-91441792ad77 in Status: SUCCESS [ 1242.366269] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.503668] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6558897-4408-4569-a23e-16757fe06906 req-389f18bc-db5f-4479-984f-8acd2b927c2c tempest-ListServerFiltersTestJSON-991622148 tempest-ListServerFiltersTestJSON-991622148-project-member] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1244.504213] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1244.504860] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.504995] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.505081] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.505332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.505489] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.505640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.505640] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.505793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.505877] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.505969] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.774436] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.774668] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.774802] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.775146] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.775409] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.775575] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.775691] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.775920] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.776086] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.776306] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.776429] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.776547] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.776662] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.776777] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.776891] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.777042] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.797781] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.797986] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.798102] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.798253] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1244.798541] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.798711] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1244.798840] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.799230] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1244.799384] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce4a978d-bcd6-44e8-a1bd-de893f94dae7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.008437] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.008693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.008693] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.008854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.008936] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.009162] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.009281] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.009345] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.009473] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.009545] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.009629] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d already deleted. [ 1245.009708] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.302174] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.302444] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.302602] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.302891] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.303154] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.303343] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port ce4a978d-bcd6-44e8-a1bd-de893f94dae7 not found, creating... [ 1245.303683] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.303928] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.304122] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.304418] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.304639] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.305009] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.305220] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.305416] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.305694] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.305875] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.306132] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: ce4a978d-bcd6-44e8-a1bd-de893f94dae7 is going to be created. [ 1245.324779] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.324974] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1245.325167] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.325474] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1245.325762] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1245.326059] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.021885] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6558897-4408-4569-a23e-16757fe06906 req-bedc86b5-7e6a-4fff-a421-45ad6aa458bf service nova] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_rules [ 1246.022282] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6558897-4408-4569-a23e-16757fe06906 req-bedc86b5-7e6a-4fff-a421-45ad6aa458bf service nova] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1246.022317] env[64436]: INFO networking_nsxv3.common.synchronization [req-b6558897-4408-4569-a23e-16757fe06906 req-bedc86b5-7e6a-4fff-a421-45ad6aa458bf service nova] Enqueued Resource ID: ce4a978d-bcd6-44e8-a1bd-de893f94dae7 with Priority: HIGHEST for action port [ 1246.023393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_rules [ 1246.023393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1246.023393] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce4a978d-bcd6-44e8-a1bd-de893f94dae7 with Priority: HIGHEST for action port [ 1246.026895] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.026895] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.026895] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.026895] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.026895] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.026895] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.027534] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.027613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.027613] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.027761] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.027834] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce4a978d-bcd6-44e8-a1bd-de893f94dae7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.530443] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.531511] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.531633] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.532182] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce4a978d-bcd6-44e8-a1bd-de893f94dae7 with status ACTIVE [ 1246.532182] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.532360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.532360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.532553] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.532642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.532812] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.532909] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.532971] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.533173] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.533400] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.533487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.533548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.533612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.533710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.533781] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.533861] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce4a978d-bcd6-44e8-a1bd-de893f94dae7 is going to be updated. [ 1246.560617] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.560757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.560802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.560983] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.561135] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.561287] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce4a978d-bcd6-44e8-a1bd-de893f94dae7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.598320] env[64436]: INFO networking_nsxv3.common.synchronization [req-7e52bcbd-6823-4e3c-9a53-32dea8d78193 req-09767b2d-3b38-452f-a161-f821bec1d5bf tempest-ListServerFiltersTestJSON-991622148 tempest-ListServerFiltersTestJSON-991622148-project-member] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1246.598806] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1246.599113] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.599208] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.825379] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.825602] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.825736] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.826017] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.826299] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.826467] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.826590] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.826820] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.826973] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.827218] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.827343] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.827461] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.827577] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.827692] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.827806] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.827943] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.845540] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.845723] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1246.845885] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.846108] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.846635] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-732484d4-f2b5-43b2-88e5-d177e7880161 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.846831] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.846971] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.847368] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.847558] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('732484d4-f2b5-43b2-88e5-d177e7880161',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.032998] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.350544] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.350821] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.350963] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.351290] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.351455] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.351628] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 732484d4-f2b5-43b2-88e5-d177e7880161 not found, creating... [ 1247.351898] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.352111] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.352243] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.352473] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.352619] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.352912] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.353184] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.353331] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.353551] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.353696] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.353844] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 732484d4-f2b5-43b2-88e5-d177e7880161 is going to be created. [ 1247.383567] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.383801] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.383920] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.384208] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.384447] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.384673] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.534582] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.534793] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.536078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.536078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.536078] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.536078] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be created. [ 1247.583790] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.583977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.583977] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.584214] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.584379] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.612062] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: UNINITIALIZED for 2s [ 1248.063065] env[64436]: INFO networking_nsxv3.common.synchronization [req-7e52bcbd-6823-4e3c-9a53-32dea8d78193 req-79a5f93e-06d7-49ca-a98e-f402e517ecc1 service nova] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_rules [ 1248.063065] env[64436]: INFO networking_nsxv3.common.synchronization [req-7e52bcbd-6823-4e3c-9a53-32dea8d78193 req-79a5f93e-06d7-49ca-a98e-f402e517ecc1 service nova] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1248.063065] env[64436]: INFO networking_nsxv3.common.synchronization [req-7e52bcbd-6823-4e3c-9a53-32dea8d78193 req-79a5f93e-06d7-49ca-a98e-f402e517ecc1 service nova] Enqueued Resource ID: 732484d4-f2b5-43b2-88e5-d177e7880161 with Priority: HIGHEST for action port [ 1248.064043] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_rules [ 1248.064276] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1248.064276] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 732484d4-f2b5-43b2-88e5-d177e7880161 with Priority: HIGHEST for action port [ 1248.064532] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.064639] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.064834] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.064916] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.065107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-732484d4-f2b5-43b2-88e5-d177e7880161 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.065204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.066396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.066396] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.066396] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('732484d4-f2b5-43b2-88e5-d177e7880161',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.567441] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 732484d4-f2b5-43b2-88e5-d177e7880161 with status ACTIVE [ 1248.567652] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.567796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.567866] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.568873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.568873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.568873] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.568873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.568873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.568873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.568873] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.569908] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.569908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.569908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.569908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.569908] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.569908] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 732484d4-f2b5-43b2-88e5-d177e7880161 is going to be updated. [ 1248.625107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.625293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.625356] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.625528] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.625714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.625879] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-732484d4-f2b5-43b2-88e5-d177e7880161" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.860632] env[64436]: INFO networking_nsxv3.common.synchronization [req-8abcea69-16c6-4ad2-94a2-d6f9ba9dada0 req-9a65e406-603c-44dc-a6bb-3a941894059c tempest-ListServerFiltersTestJSON-991622148 tempest-ListServerFiltersTestJSON-991622148-project-member] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1248.860956] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1248.861298] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.861420] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.146954] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.147255] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.147299] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.147561] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.147821] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.147981] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.148166] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.148389] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.148536] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.148747] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.148865] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.148978] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.149102] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.149406] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.149540] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.149677] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.167764] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.167931] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1249.168102] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.168352] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-88" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.168653] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.168826] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.168953] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.169271] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.169416] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6860620-1d95-4aed-9fd6-4fc4c1f2e64c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.622600] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1249.622942] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.623249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.623552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.623831] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.624028] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.624143] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.624384] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.624517] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.624656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.624801] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.625919] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.627057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.627057] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.627057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.627057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.627057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.627057] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.627355] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.671817] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.672169] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.672408] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.672816] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.673087] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.673356] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port f6860620-1d95-4aed-9fd6-4fc4c1f2e64c not found, creating... [ 1249.673782] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.674061] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.674287] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.674635] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.674873] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.675353] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.675616] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.675826] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.676171] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.676411] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.676653] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: f6860620-1d95-4aed-9fd6-4fc4c1f2e64c is going to be created. [ 1249.698734] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.698969] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.699158] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.699500] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.699740] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.699989] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.129198] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.129388] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.129533] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.410486] env[64436]: INFO networking_nsxv3.common.synchronization [req-8abcea69-16c6-4ad2-94a2-d6f9ba9dada0 req-5cd2b3f8-fd37-43a9-ae96-e19facc889f2 service nova] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_rules [ 1250.410486] env[64436]: INFO networking_nsxv3.common.synchronization [req-8abcea69-16c6-4ad2-94a2-d6f9ba9dada0 req-5cd2b3f8-fd37-43a9-ae96-e19facc889f2 service nova] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1250.410486] env[64436]: INFO networking_nsxv3.common.synchronization [req-8abcea69-16c6-4ad2-94a2-d6f9ba9dada0 req-5cd2b3f8-fd37-43a9-ae96-e19facc889f2 service nova] Enqueued Resource ID: f6860620-1d95-4aed-9fd6-4fc4c1f2e64c with Priority: HIGHEST for action port [ 1250.410486] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_rules [ 1250.411208] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1250.411607] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6860620-1d95-4aed-9fd6-4fc4c1f2e64c with Priority: HIGHEST for action port [ 1250.412143] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.412547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.412966] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.413252] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.413647] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.413965] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.414206] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.414579] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.414803] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6860620-1d95-4aed-9fd6-4fc4c1f2e64c',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.632058] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.917977] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6860620-1d95-4aed-9fd6-4fc4c1f2e64c with status ACTIVE [ 1250.918324] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.918504] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.918601] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.918862] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.918962] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.919163] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.919270] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.919336] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.919493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.919572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.919761] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.919851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.919914] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.920073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.920140] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.920228] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6860620-1d95-4aed-9fd6-4fc4c1f2e64c is going to be updated. [ 1250.952409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.952632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.952632] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.952831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.952985] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.953184] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6860620-1d95-4aed-9fd6-4fc4c1f2e64c" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.134397] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.134597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.134597] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.134820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.134910] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.135025] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1251.168239] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.168447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1251.168447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.168642] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1251.168734] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1251.179134] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1253.191882] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1253.192259] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.192337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.192548] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.192731] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.192846] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.192912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.193075] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.193162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.193270] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.696024] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.198415] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.701264] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.701520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.701520] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.701803] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.701900] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1254.702026] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1254.752212] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.752387] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1254.752482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.752737] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1254.752922] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1254.762353] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1255.413282] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.413845] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1255.448590] env[64436]: INFO networking_nsxv3.common.synchronization [req-3bc32ce8-fc0d-4009-9d1b-20acd4ccae1c req-cd5864fd-5624-4e85-acc0-e5fb2c63fd3e tempest-ServerActionsTestOtherA-1790656445 tempest-ServerActionsTestOtherA-1790656445-project-member] Enqueued Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1255.449119] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a with Priority: HIGHEST for action security_group_members [ 1255.449426] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a7055f1-b6d2-4437-9167-b5ee510dd08a taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.449709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.449709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.449810] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.449949] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.450069] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.450156] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.450257] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.450334] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.450825] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a7055f1-b6d2-4437-9167-b5ee510dd08a',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.954070] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.954070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.954070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.954070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.954070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.954070] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.954070] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.954560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.954560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.954560] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.954560] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a is going to be updated. [ 1255.984802] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.985066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1255.985066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.985309] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1255.985359] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.994093] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: IN_PROGRESS for 2s [ 1256.775310] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1256.775634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.775820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.776123] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.776374] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.776537] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1256.776638] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.776883] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1256.777013] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1256.777159] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.280037] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.782709] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.003848] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a in Status: SUCCESS [ 1258.004053] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a7055f1-b6d2-4437-9167-b5ee510dd08a deletion is rescheduled due to dependency. [ 1258.004137] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a7055f1-b6d2-4437-9167-b5ee510dd08a" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1258.285815] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.286060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1258.286060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.286282] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1258.286375] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1258.286477] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1258.351929] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.351929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1258.351929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.352204] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1258.352732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1258.363786] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1260.377030] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.377030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.377030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.377030] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.377030] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.378065] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.378065] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.379101] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.379391] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.379638] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.379854] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.380068] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.380307] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.380482] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.380653] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.449833] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.449998] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1260.882306] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc54c4bb-6738-45a9-a391-c9bf97eb231d: rpc.has_security_group_logging(os_id): False [ 1260.883411] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.900985] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.901148] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.901217] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.901423] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.901516] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.901732] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.901832] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.901898] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.902062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.902197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.902390] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.902488] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.902550] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.902690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.902764] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.902948] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.903066] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1260.903197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.903355] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1260.903430] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1260.903514] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be created. [ 1261.021331] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.021620] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.021701] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.021928] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.022172] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1261.033169] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1261.386000] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.888692] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.888946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.888946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.889219] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.889363] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1261.889472] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1261.929774] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.929986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1261.929986] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.930215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1261.930366] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1261.940559] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1263.045258] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1263.045588] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.045647] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.045842] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.045928] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.548687] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.548925] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.949933] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1263.950181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.950349] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.950571] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.950757] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.950878] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1263.950981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.951103] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1263.951192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.951338] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1263.951452] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.454156] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.454555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.454555] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.454630] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.454762] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.454867] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.454932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.455121] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.455215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.455337] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.455447] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.455539] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.455594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.455732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.455865] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.455955] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.456025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.456162] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.456237] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.456315] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.456403] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.959210] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc54c4bb-6738-45a9-a391-c9bf97eb231d: rpc.has_security_group_logging(os_id): False [ 1264.977591] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.977672] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.977732] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.977946] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.978053] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.978274] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.978380] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.978444] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.978592] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.978668] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.978838] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.978929] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.978991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.979153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.979248] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.979440] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.979534] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1264.979596] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.979735] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1264.979811] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1264.979895] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1265.037517] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.037714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.037714] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.037880] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.038039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.052449] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1265.451061] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.451265] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1267.068110] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1267.068110] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1267.068495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.068495] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1267.068495] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.571114] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.571274] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1267.571370] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.571594] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1267.571736] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.571839] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1267.571899] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.572062] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1267.572149] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1267.572267] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1267.572363] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.074353] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.074712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.074712] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.074798] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.076194] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.076194] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.076194] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.076194] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.076694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.076694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.076694] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.076694] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.579330] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc54c4bb-6738-45a9-a391-c9bf97eb231d: rpc.has_security_group_logging(os_id): False [ 1268.596064] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.596284] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.596399] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.596552] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.596644] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.596863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.596968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.597052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.597188] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.597268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.597450] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.597544] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.597607] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.597742] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.597819] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.598010] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.598105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.598164] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.598326] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.598406] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.598491] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1268.751999] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.752245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1268.752245] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.752491] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1268.752645] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1268.769309] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1270.452664] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.453115] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1270.726029] env[64436]: INFO networking_nsxv3.common.synchronization [req-d2fc5971-efc5-4841-a29c-3b1f922c9fb2 req-f5e4921f-30f2-4d82-9112-e0d66b24c9a4 tempest-ListServerFiltersTestJSON-991622148 tempest-ListServerFiltersTestJSON-991622148-project-member] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1270.726149] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1270.726863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.726863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.726863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.726863] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.726863] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.727171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1270.727171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.727171] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1270.727360] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1270.727360] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.785694] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1270.785864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1271.229346] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.732186] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.235060] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.235060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.235060] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.235447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.235447] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.235516] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1272.263765] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.263991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1272.264079] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.264308] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1272.264465] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1272.272620] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1274.283860] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1274.284115] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1275.727445] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.727802] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.260033] env[64436]: INFO networking_nsxv3.common.synchronization [req-34404298-ab4c-45d6-8996-d1e062fac2c5 req-9b0b3d78-7806-4393-ab0e-878a4e5b3dd0 tempest-ListServerFiltersTestJSON-991622148 tempest-ListServerFiltersTestJSON-991622148-project-member] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1277.260608] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1277.260922] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.261100] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.261178] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.261373] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.261529] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.261641] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1277.261709] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.261831] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1277.261912] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1277.261999] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.765411] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.267758] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.770107] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.770365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1278.770365] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.770563] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1278.770654] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1278.770755] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1278.799011] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.799425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1278.799425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.799425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1278.799591] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1278.808818] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1280.819896] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1280.820342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1282.261412] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.261798] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1283.872461] env[64436]: INFO networking_nsxv3.common.synchronization [req-c43a6aee-c255-440a-989f-dabc54c4bc30 req-0c9cd50b-669a-4554-aaa4-7c645c251ddc tempest-ListServerFiltersTestJSON-991622148 tempest-ListServerFiltersTestJSON-991622148-project-member] Enqueued Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1283.872461] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d with Priority: HIGHEST for action security_group_members [ 1283.872461] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc54c4bb-6738-45a9-a391-c9bf97eb231d taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.872461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.872461] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.873109] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.873415] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.873656] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.875133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.875133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.875133] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.875133] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc54c4bb-6738-45a9-a391-c9bf97eb231d',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.378265] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.378519] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.378648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.378993] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.379186] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.379488] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.379661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.379766] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.379963] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.380084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.380178] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d is going to be updated. [ 1284.409117] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.409272] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.409368] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.409585] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.409726] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.417761] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: IN_PROGRESS for 2s [ 1286.428380] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d in Status: SUCCESS [ 1286.428796] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc54c4bb-6738-45a9-a391-c9bf97eb231d deletion is rescheduled due to dependency. [ 1286.428796] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc54c4bb-6738-45a9-a391-c9bf97eb231d" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1288.872049] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.872433] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.873717] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.874161] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1297.866546] env[64436]: INFO networking_nsxv3.common.synchronization [req-60cd891f-8959-44c9-a743-57c713e33531 req-cf02f43c-1549-4126-a069-a05d7aed7fb3 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_members [ 1297.867126] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a459f0-d6c9-4693-a4db-91441792ad77 with Priority: HIGHEST for action security_group_members [ 1297.867487] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1a459f0-d6c9-4693-a4db-91441792ad77 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.867634] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1297.867724] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.867997] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1297.868409] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.868409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1297.868409] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.868612] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1297.868648] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1297.868729] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1a459f0-d6c9-4693-a4db-91441792ad77',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.371821] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.372041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1298.372099] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.372293] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1298.372383] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1298.372620] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.372757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1298.372757] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.372921] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1298.372996] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1298.373095] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1a459f0-d6c9-4693-a4db-91441792ad77 is going to be updated. [ 1298.403880] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.404039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1298.404039] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.404197] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1298.404332] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1298.412072] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1a459f0-d6c9-4693-a4db-91441792ad77 in Status: IN_PROGRESS for 2s [ 1300.423077] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1a459f0-d6c9-4693-a4db-91441792ad77 in Status: SUCCESS [ 1300.423435] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1a459f0-d6c9-4693-a4db-91441792ad77 deletion is rescheduled due to dependency. [ 1300.423435] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1a459f0-d6c9-4693-a4db-91441792ad77" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.439180] env[64436]: INFO networking_nsxv3.common.synchronization [None req-9aac2db0-c317-4b1b-ac70-74d505bb183a tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_rules [ 1302.439669] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_rules [ 1302.439970] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.440105] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.440181] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.440425] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.440511] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.500707] env[64436]: INFO networking_nsxv3.common.synchronization [None req-081a3f4f-160f-460f-aa51-10e2c95c4004 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_rules [ 1302.501192] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_rules [ 1302.501496] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.501602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.961736] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.961932] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1302.961981] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.962232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.962330] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.962427] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 already deleted. [ 1302.962540] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1302.962690] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.962851] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1302.962936] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.482778] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.483211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1303.483211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.483211] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1303.483321] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1303.483370] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 already deleted. [ 1303.483452] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.501868] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.502271] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.682165] env[64436]: INFO networking_nsxv3.common.synchronization [req-873f5fa8-d28c-4334-8f9b-860b44562135 req-3020c0c3-5ded-40fe-8e60-53d83728f5f6 tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_members [ 1307.683247] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_members [ 1307.683247] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.683247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.683247] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.683451] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.683604] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.683710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.683768] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.683933] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.684025] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.684116] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.932587] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.932824] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.932961] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.933249] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.933520] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.933715] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.933839] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.934069] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.934221] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.934435] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1307.934554] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] NeedRegenerationException {{(pid=64436) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1307.934666] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] no value, waiting for create lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1307.934778] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] value creation lock acquired {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1307.934889] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] No value present for key: 'zone-id' {{(pid=64436) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1307.934997] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Calling creation function for not-yet-present value {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1307.935146] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1307.954302] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1307.954455] env[64436]: DEBUG dogpile.cache.region [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=64436) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1307.954595] env[64436]: DEBUG dogpile.lock [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Released creation lock {{(pid=64436) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1307.954767] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "network-705" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1307.955105] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock port-98c4f62b-0f02-4f26-a374-ae93a0c6a777 taken with stack trace [, , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.955276] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1307.955399] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.955677] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1307.955819] env[64436]: DEBUG networking_nsxv3.api.rpc [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c4f62b-0f02-4f26-a374-ae93a0c6a777',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.187066] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.187276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.187276] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.187489] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.187578] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.187793] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.187947] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.188024] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.188192] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.188305] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.188368] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 already deleted. [ 1308.188436] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.458919] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.458919] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.458919] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.459455] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.459455] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.459534] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Segment Port 98c4f62b-0f02-4f26-a374-ae93a0c6a777 not found, creating... [ 1308.459785] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.459950] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.460084] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.460368] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.460452] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.460767] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.460935] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.461070] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.461289] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.461433] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.461577] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Resource: SegmentPort with ID: 98c4f62b-0f02-4f26-a374-ae93a0c6a777 is going to be created. [ 1308.481727] env[64436]: DEBUG networking_nsxv3.common.locking [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.481918] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.482027] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.482294] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.482542] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.482824] env[64436]: DEBUG oslo_concurrency.lockutils [None req-9369bbb1-9cf1-4fd4-90e8-192bdb5f2b20 None None] Releasing lock "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.150585] env[64436]: INFO networking_nsxv3.common.synchronization [req-873f5fa8-d28c-4334-8f9b-860b44562135 req-ffdfccf3-88ad-4ff2-a602-11bba6198376 service nova] Enqueued Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_rules [ 1309.150828] env[64436]: INFO networking_nsxv3.common.synchronization [req-873f5fa8-d28c-4334-8f9b-860b44562135 req-ffdfccf3-88ad-4ff2-a602-11bba6198376 service nova] Enqueued Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_members [ 1309.150923] env[64436]: INFO networking_nsxv3.common.synchronization [req-873f5fa8-d28c-4334-8f9b-860b44562135 req-ffdfccf3-88ad-4ff2-a602-11bba6198376 service nova] Enqueued Resource ID: 98c4f62b-0f02-4f26-a374-ae93a0c6a777 with Priority: HIGHEST for action port [ 1309.151171] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_rules [ 1309.151302] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_members [ 1309.151394] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c4f62b-0f02-4f26-a374-ae93a0c6a777 with Priority: HIGHEST for action port [ 1309.151929] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.152168] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.152249] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.152449] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.152530] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.153367] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.153477] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.153547] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.153720] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.153875] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.153969] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.154041] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.154182] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.154268] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.154353] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.155728] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c4f62b-0f02-4f26-a374-ae93a0c6a777 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.159020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.159020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.159020] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.159020] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c4f62b-0f02-4f26-a374-ae93a0c6a777',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.656736] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.657940] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98c4f62b-0f02-4f26-a374-ae93a0c6a777 with status ACTIVE [ 1309.658233] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.658405] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.658503] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.658774] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.658901] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.659203] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.659301] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.659393] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.661031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.661031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.661031] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.661031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.661031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.661031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.661031] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.661031] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98c4f62b-0f02-4f26-a374-ae93a0c6a777 is going to be updated. [ 1309.662412] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.662525] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.694421] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.694602] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.694710] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.694991] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.695228] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.695464] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c4f62b-0f02-4f26-a374-ae93a0c6a777" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.163731] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.665948] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.666224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.666224] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.666476] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.666572] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.666678] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 is going to be created. [ 1310.690994] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.691146] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.691256] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.691415] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.691573] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.703999] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 in Status: UNINITIALIZED for 2s [ 1312.715088] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 in Status: SUCCESS [ 1312.715450] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1312.715493] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.715706] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1312.715906] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.716029] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1312.716094] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.716263] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1312.716344] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1312.716429] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1312.716517] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.218802] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.720762] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7: rpc.has_security_group_logging(os_id): False [ 1313.737800] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.737979] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1313.738044] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.738232] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1313.738323] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.738569] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.738674] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1313.738740] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.738889] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1313.738968] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.739070] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 is going to be created. [ 1313.794514] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.794646] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1313.794687] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.794864] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1313.795052] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.805464] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 in Status: IN_PROGRESS for 2s [ 1314.152628] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.152628] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1315.817027] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 in Status: SUCCESS [ 1315.817472] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1319.153804] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.153804] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.154779] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.155271] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.155904] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.156209] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1334.157849] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.158218] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.158811] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1339.159139] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1344.160347] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.160798] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.162174] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.162449] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.163409] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.163772] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.165061] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.165351] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.166105] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.166559] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.166900] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.167229] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1370.959988] env[64436]: INFO networking_nsxv3.common.synchronization [req-18dad61d-e2ab-4647-b920-ce2a8bed843b req-489384ee-93bd-4571-ba6a-b4fe6395f8cc tempest-AttachVolumeNegativeTest-1735235516 tempest-AttachVolumeNegativeTest-1735235516-project-member] Enqueued Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_members [ 1370.960340] env[64436]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 with Priority: HIGHEST for action security_group_members [ 1370.960661] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 taken with stack trace [, , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.960802] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1370.960847] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.961215] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1370.961285] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.961342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1370.961408] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.961575] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1370.961661] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1370.961756] env[64436]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e49cf7b-ed04-4f48-a1f0-513e641bd2b7',) {} {{(pid=64436) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.464042] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.464277] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1371.464342] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.464820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1371.464820] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1371.464958] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.464958] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1371.465073] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.465163] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1371.465242] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1371.465328] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 is going to be updated. [ 1371.500904] env[64436]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=64436) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.501084] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1371.501153] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.501294] env[64436]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1371.501428] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1371.510854] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 in Status: IN_PROGRESS for 2s [ 1373.522410] env[64436]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 in Status: SUCCESS [ 1373.522843] env[64436]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e49cf7b-ed04-4f48-a1f0-513e641bd2b7 deletion is rescheduled due to dependency. [ 1373.522843] env[64436]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e49cf7b-ed04-4f48-a1f0-513e641bd2b7" {{(pid=64436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1375.961742] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.962215] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.962997] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.963404] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.963974] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.964365] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.964865] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.965503] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.965741] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.966142] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.967345] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.967685] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.968491] env[64436]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.968859] env[64436]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0